Cost Function refers to a fundamental principle in machine learning used to evaluate how well a model’s predictions align with actual outcomes, guiding model optimization through error reduction.