2024 Cornell Optimization Open Textbook Feedback

Trust-region methods

• For the applications section, a better method is to briefly summarize the advantages of the method in multiple areas, instead of presents its application on two very specific cases.
• Please try to update equations on page 5.
• Please try to use the pseudocode for the procedure described on page 3.
• m_k and p in eq.(1) are not defined.
• Fix the typo “prediced reduction” in eq.(3).
• Avoid using contraction (e.g., it’s, doesn’t) and pronouns (e.g., we, us) in scientific writing.
• Rewrite the sentence, “Identical to line search, we do not need to compute the algorithm (2)” as (2) itself is not an algorithm.
• The termination conditions are not complete in section “Termination Criteria”.
• Fletcher is not the same author as cited in [5].

Stackelberg leadership model

• Please make citations immediately after the citing contents. Please double-check all the citations in your file.
• Please include more citations in the application section to support your statements.
• Please use flowchart/pseudocode for representing the steps of algorithm
• Check the consistency of abbreviations (e.g. what is PAWS?)
• Sections 5-7 can be combined into one section and divided by subsections.

Quadratic constrained quadratic programming

• Please double-check that all cited Figures are clearly attached with citations.
• Please double-check the citations of your references.
• Need significant amount of citation to support the statement
• Mentioned the ways to relax the non convex set, so please provide at least one example either from SDP or RLT.
• Double check with abbreviations (e.g. KKT and SDP should be defined at the beginning sections)
• Equations should be written in a formal way (e.g. 1/2 should be 1 on top and 2 on the bottom)
• Abbreviations should be introduced only once throughout all sections (e.g., QCQP, QP, SDP)
• Avoid using pronouns (e.g., we) in scientific writing.
• Please revise “Ex. Objective” and “Ex. Constraint” parts in a more professional way in the Application section.

Derivative free optimization

• Please avoid the use of the term like "you" or "we" in the Wiki file.
• Please include more citations to support your statements in the application section.
• Please add more citations to support your statement in the introduction section
• Please try to include a flowchart or pseudocode for illustration of the algorithm.
• If DFO is defined in the previous sections, please use such abbreviations consistently (same for other abbreviations).
• Please add subheadings in the Application section for better readability.

Adafactor

• The clarity of the alghrithm and numerical example session needs to be improved. It is convenient to list all equations, but not good to present it to others.
• Please revise your reference format.
• More citations are needed for supporting your statement in the introduction section.
• For the section "software tools and platforms" please provide more details, e.g. how PyTorch is using such optimizers and how this platform introduced this algorithm (do not directly copy and remember to add citation if this is not your own idea).
• The sentence "This article mainly introduces Adafactor and its function, algorithm, and application." can be removed.
• Algorithm and theory section is missing.

AdamW

• Please double-check if the citations are correctly formatted in the text.
• For the application section, it would be good to emphasize the advantages of AdamW compared to other approach by citing the quantitative results from previous literature.
• Please provide flowchart/pseudocode for representing your procedure
• Please provide citations for your statement (e.g. how AdamW used in Finance, where is your source)
• Avoid using pronouns (e.g., we, let's) in scientific writing.
• The code snippet in the Application section can be removed.

Beyesian optimization

• Only suggestion is that providing code may not be appropriate in the Wiki page (all on your decision).
• Citation number should be double checked.
• You can use abbreviations if some special terms appeared multiple times (e.g. Bayesian Optimization -> BO).
• Avoid using pronouns (e.g., we) in scientific writing.
• There is no need to show your own code in this wiki page.
• Avoid adding citations in the conclusion section

Genetic algorithm

• Are the Figures used in the text self-generated or cited? If cited, please add citations. Also the resolution of the figures may need to be improved. Looks like two Figure 1 are included, please fix it.
• Please provide some citations for supporting your statement (e.g. in Introduction)
• Abbreviations should be consistent throughout the context (e.g. GA)
• Please avoid citing or adding links to Wikipedia.
• Please remove the sentence, "as documented in Computational Optimization and Applications."
• More details are expected for Algorithm Discussion section.

Simulated annealing

• Please provide citations in the application section to support your statements.
• Provide some figures for the numerical study
• Substitute those symbols in a formal way (e.g. T_min should be in a formal way).
• Once the abbr. is defined please use it throughout the context (e.g. SA)
• There are many extra words throughout the sections, (e.g., “Spaces” in the last sentence of Introduction section, “D.” in section 2.1)
• Avoid using pronouns (e.g., we) in scientific writing.