Upgrade LLM Performance: Smart Experimentation Techniques