• Stochastic Methods
  • Noisy Descent
  • Mesh Adaptive Direct Search
  • simulated annealing
    • Metropolis Criteria
    • Simulated Annealing Schedule
    • Cross Entropy Method
  • Natural Evolution
• Population Methods
  • Generic Algorithms
  • Particle Swarm Optimization
• constraints
  • active constraint
  • region-based constraints
  • Lagrange multiplier
    • primal problem
    • KKT Conditions
    • dual form of the primal problem
  • Penalty Methods
  • Interior Point Method
• Linear Program
  • FONC for linear program
  • linear program equality form
  • FONC for linear program
  • simplex algorithm
  • Dual Certificates