Abstract
ABSTRACT
Scientific optimization problems are often characterized by slow, expensive, and non‐differentiable evaluations, which severely limit efficient exploration of rich design spaces. In these settings, performance depends not only on the optimizer itself, but also on whether the chosen search space can represent good solutions and whether important design requirements are effectively incorporated into the search. Here, we introduce a gradient‐free optimization framework based on large language models (LLMs) that enables the generation and refinement of executable control policies directly from natural language. We propose two complementary paradigms: Prompt‐to‐Optimizer (P2O), which combines LLM‐based structural generation with gradient‐free parameter optimization, and Prompt‐to‐Protocol (P2P), which directly synthesizes fully specified control policies. We apply this framework to battery fast‐charging protocol design, a representative slow‐feedback optimization problem. Across multiple case studies, our methods outperform conventional approaches restricted to predefined functional forms. In a realistic fast‐charging scenario, both approaches improve battery state of health by approximately 4.2% over a representative baseline, with P2P achieving this under matched evaluation budgets. More broadly, our results suggest that LLMs can serve as representation generators that expand the hypothesis space of scientific optimization, enabling efficient search in domains where evaluations are costly, and gradients are unavailable.