2024 Cornell Optimization Open Textbook Feedback: Difference between revisions

From Cornell University Computational Optimization Open Textbook - Optimization Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(12 intermediate revisions by 2 users not shown)
Line 3: Line 3:


== [[Heuristic algorithms]] ==
== [[Heuristic algorithms]] ==
*More details on the Application Section.
*Adding more details to the Application Section is recommended.
*Please come up with one numerical example with hill-climbing.
*Please use FigureX as a reference in the text.
*Please add more references to support the content in the Introduction section.
*Avoid using contraction (e.g., there's) in scientific writing.
*Please add figure captions for the pseudocodes.  
*Avoid using contraction (e.g., we're) and pronouns (e.g., we) in scientific writing.
*ResearchGate is not a publisher. Please check the reference again.  


== [[Local branching]] ==
== [[Local branching]] ==
Line 16: Line 13:


== [[Trust-region methods]] ==
== [[Trust-region methods]] ==
*For the applications section, a better method is to briefly summarize the advantages of the method in multiple areas, instead of presents its application on two very specific cases.
*Please label the figures with numbers and direct readers to the figures in text.
*Please try to update equations on page 5.
*References were not well formatted (e.g., Yuan, Y. (2015b)).
*Please try to use the pseudocode for the procedure described on page 3.
*m_k and p in eq.(1) are not defined.
*Fix the typo “prediced reduction” in eq.(3).
*Avoid using contraction (e.g., it’s, doesn’t) and pronouns (e.g., we, us) in scientific writing.
*Rewrite the sentence, “Identical to line search, we do not need to compute the algorithm (2)” as (2) itself is not an algorithm.
*The termination conditions are not complete in section “Termination Criteria”.
*Fletcher is not the same author as cited in [5].


== [[Quadratic programming]] ==
== [[Quadratic programming]] ==
Line 35: Line 25:
*The application section was not well drafted and supported by references.
*The application section was not well drafted and supported by references.


== [[Dynamic optimization]] ==
== [[Eight step procedures]] ==
*For the algorithm description, it would be better to have a pseudocode or a flow chart to summarize it.
*For the algorithm description, it would be better to have a pseudocode or a flow chart to summarize it.
*Attaching code to the Wiki editing page is not recommended.
*Please use Latex equation editor for equations.
*It would be better to provide more references for supporting the statements made in the Application Section.
*Please number and label all figures and tables, use FigureX, TableX as a reference in the text.
*Please try to add more citations in the introduction section.
*Please place references after the period at the end of each sentence and avoid after the optimization problems. This goes for all the sections in the wiki.
*In-text citations are required.
*Avoid using contraction (e.g., you've, don't) and pronouns (e.g., we, us) in scientific writing.
*Please add some mathematical expressions to Algorithm Discussion section for explicitness.
*Adding a different type of problem would be recommended instead of making Knapsack Problem larger size.
*In-text citation should be added to figure captions.  
   
   
== [[Nondifferentiable Optimization]] ==
== [[Nondifferentiable Optimization]] ==
*If the topic is about nondifferntial optimization, then it would be strange that only one approach is included in the Wiki page.
*Most contents are from previous year. The Wiki page should be your original content.
*It is also recommended to revise the citation format in the file based on our example files.
*It is also recommended to revise the citation format based on our example files.
*Please add the case of non convex functions.
*Please add the case of non convex functions.
*Please add references to support the content in the Introduction section. In-text citations are required.
*Please add references to support the content in the Introduction section. In-text citations are required.
*Please use Latex equation editor for typing symbols and equations.
*Please use Latex equation editor for typing symbols and equations.
*There are multiple methods introduced in the Introduction section. Please expand the Algorithm Discussion section and add more details.
*The Numerical Example section is incomplete.
*The provided example is somewhat trivial. Please provide a more sophisticated example.
*Application and Conclusion sections are missing.
*It should be "CVXPY" instead of "CVXpy" and "MATLAB" instead of "Matlab" in Application and Conclusion sections.


== [[Evolutionary multimodal optimization]] ==
== [[Evolutionary multimodal optimization]] ==
*It would be better to have subsections of each approach in the Algorithm Discussion section to improve the clarity.
*Please include more citations in Algorithm Discussion section to support the contents.
*The logic flow and clarity of both the Algorithm Discussion section and Numerical Example section need to be largely improved.
*Please use FigureX as a reference in the text.
*Please include citations to support the Wiki contents.
*Please make sure abbreviations should be consistent throughout the context.
*In-text citations are required.
*Please add mathematical expressions to Algorithm Discussion section for explicitness.
*Please provide step by step calculation for the numerical example.
*Adding some figures may help reader to understand the content.


== [[Stackelberg leadership model]] ==
== [[Stackelberg leadership model]] ==
*Please make citations immediately after the citing contents. Please double-check all the citations in your file.
*Please include more citations in the application section to support your statements.
*Please use flowchart/pseudocode for representing the steps of algorithm
*Please use flowchart/pseudocode for representing the steps of algorithm
*Check the consistency of abbreviations (e.g. what is PAWS?)
*Check the consistency of abbreviations (e.g. what is PAWS?)
*Sections 5-7 can be combined into one section and divided by subsections.


== [[Quadratic constrained quadratic programming]] ==
== [[Quadratic constrained quadratic programming]] ==
Line 79: Line 54:


== [[Derivative free optimization]] ==
== [[Derivative free optimization]] ==
*Please avoid the use of the term like "you" or "we" in the Wiki file.
*Please include more citations to support your statements in the application section.
*Please add more citations to support your statement in the introduction section
*Please try to include a flowchart or pseudocode for illustration of the algorithm.
*Please try to include a flowchart or pseudocode for illustration of the algorithm.
*If DFO is defined in the previous sections, please use such abbreviations consistently (same for other abbreviations).
*If DFO is defined in the previous sections, please use such abbreviations consistently (same for other abbreviations).
*Please add subheadings in the Application section for better readability.


== [[Signomial problems]] ==
== [[Signomial problems]] ==
Line 91: Line 62:


== [[Adadelta]] ==
== [[Adadelta]] ==
*Adding a subsection title to divide the numerical examples will improve the clarity of this file.
*There is an extra line of citation links in the References section.
*Please add the platforms (e.g. PyTorch, TF) to illustrate how this algorithm is introduced.
*Avoid using contraction (e.g., it’s, doesn’t) and pronouns (e.g., we, let's) in scientific writing.
*Citation of each algorithm should be added in the sentence "such as RMSprop, Adam, and Nadam, exist as well."
*Abbreviations should be introduced one time only throughout all sections (e.g., RNNs).


== [[Adafactor]] ==
== [[Adafactor]] ==
*The clarity of the alghrithm and numerical example session needs to be improved. It is convenient to list all equations, but not good to present it to others.
*The clarity of the alghrithm and numerical example session needs to be improved. It is convenient to list all equations, but not good to present it to others.
*Please revise your reference format.
*More citations are needed for supporting your statement.
*More citations are needed for supporting your statement in the introduction section.
*For the section "software tools and platforms" please provide more details, e.g. how PyTorch is using such optimizers and how this platform introduced this algorithm (do not directly copy and remember to add citation if this is not your own idea).
*The sentence "This article mainly introduces Adafactor and its function, algorithm, and application." can be removed.
*Algorithm and theory section is missing.  


== [[AdamW]] ==
== [[AdamW]] ==
*Please double-check if the citations are correctly formatted in the text.
*For the application section, it would be good to emphasize the advantages of AdamW compared to other approach by citing the quantitative results from previous literature.
*For the application section, it would be good to emphasize the advantages of AdamW compared to other approach by citing the quantitative results from previous literature.
*Please provide flowchart/pseudocode for representing your procedure
*Please provide citations for your statement (e.g. how AdamW used in Finance, where is your source)
*Avoid using pronouns (e.g., we, let's) in scientific writing.
*Avoid using pronouns (e.g., we, let's) in scientific writing.
*The code snippet in the Application section can be removed.


== [[Adamax]] ==
== [[Adamax]] ==
Line 125: Line 84:


== [[LossScaleOptimizer|LossscaleOptimizer]] ==
== [[LossScaleOptimizer|LossscaleOptimizer]] ==
*Provide more citations to support your statements in the Application section?
*More citations are needed for supporting the statement and applications.
*Provide a figure to demonstrate the results generated from the numerical example?
*Please provide more applications
*Please provide the platform which used such algorithms
*The Conclusion section is missing.


== [[Nadam]] ==
== [[Nadam]] ==
Line 136: Line 91:


== [[Bayesian optimization|Beyesian optimization]] ==
== [[Bayesian optimization|Beyesian optimization]] ==
*Only suggestion is that providing code may not be appropriate in the Wiki page (all on your decision).
*Citation form (in text) should be double checked.
*Citation number should be double checked.
*You can use abbreviations if some special terms appeared multiple times (e.g. Bayesian Optimization -> BO).
*Avoid using pronouns (e.g., we) in scientific writing.
*There is no need to show your own code in this wiki page.
*Avoid adding citations in the conclusion section


== [[Genetic algorithm]] ==
== [[Genetic algorithm]] ==
Line 154: Line 104:


== [[Differential evolution]] ==
== [[Differential evolution]] ==
*Provide more references to support the statements made in the Application Section.
*Once abbreviations are introduced, please make sure the full term do not appear throughout the context.
*Make sure abbreviations are consistent throughout the context (e.g. Please define DE at the introduction section not in the later section, please check the similar cases as well).
*Visualization section is not necessary. Figures should be embedded in the Wiki page.
*In-text citations are required.
*Conclusion and References sections should not belong to Application section.
*The symbols in the pseudocode is not in proper format. Please use Latex equation editor for this.
*References are already shown at the bottom of the page. The extra list should be removed.
*Please number and label all figures, use FigureX as a reference in the text.
*Please add more details to numerical example (e.g., replace x = -7 with -5 because f(x1) > f(u1))

Latest revision as of 19:26, 17 December 2024

Computational complexity

  • References were not provided to support applications on computer science and quantum computing.

Heuristic algorithms

  • Adding more details to the Application Section is recommended.
  • Please use FigureX as a reference in the text.
  • Avoid using contraction (e.g., there's) in scientific writing.

Local branching

  • The title should be “Problem Solution” instead of ”Problem Resolution“.
  • The added figure is too small for viewing from the main page and also lacks captions and explanations.
  • There are still some formatting issues with the subtitles. For example, some are in bold form while others are not in the content.

Trust-region methods

  • Please label the figures with numbers and direct readers to the figures in text.
  • References were not well formatted (e.g., Yuan, Y. (2015b)).

Quadratic programming

  • An inappropriate nonconvex example was used in the Wiki Page. The problem is an MIQP problem instead of a single QP problem.
  • Some symbols used in the pseudocodes still lack explanation.

Subgradient optimization

  • References were not well formatted.
  • Symbols used in equations lack explanations.
  • The application section was not well drafted and supported by references.

Eight step procedures

  • For the algorithm description, it would be better to have a pseudocode or a flow chart to summarize it.
  • Please use Latex equation editor for equations.
  • Please number and label all figures and tables, use FigureX, TableX as a reference in the text.
  • Please place references after the period at the end of each sentence and avoid after the optimization problems. This goes for all the sections in the wiki.

Nondifferentiable Optimization

  • Most contents are from previous year. The Wiki page should be your original content.
  • It is also recommended to revise the citation format based on our example files.
  • Please add the case of non convex functions.
  • Please add references to support the content in the Introduction section. In-text citations are required.
  • Please use Latex equation editor for typing symbols and equations.
  • The Numerical Example section is incomplete.
  • Application and Conclusion sections are missing.

Evolutionary multimodal optimization

  • Please include more citations in Algorithm Discussion section to support the contents.
  • Please use FigureX as a reference in the text.

Stackelberg leadership model

  • Please use flowchart/pseudocode for representing the steps of algorithm
  • Check the consistency of abbreviations (e.g. what is PAWS?)

Quadratic constrained quadratic programming

  • Form of in-text citation is not proper
  • Abbreviations should be introduced only once throughout all sections (e.g., QCQP, QP, SDP)
  • Avoid using pronouns (e.g., we) in scientific writing.

Derivative free optimization

  • Please try to include a flowchart or pseudocode for illustration of the algorithm.
  • If DFO is defined in the previous sections, please use such abbreviations consistently (same for other abbreviations).

Signomial problems

  • There is a lack of numerical examples for illustrating the global optimization method introduced on the Wiki page.
  • The clarification of the equations used in the Introduction section needs to be improved.

Adadelta

  • There is an extra line of citation links in the References section.

Adafactor

  • The clarity of the alghrithm and numerical example session needs to be improved. It is convenient to list all equations, but not good to present it to others.
  • More citations are needed for supporting your statement.

AdamW

  • For the application section, it would be good to emphasize the advantages of AdamW compared to other approach by citing the quantitative results from previous literature.
  • Avoid using pronouns (e.g., we, let's) in scientific writing.

Adamax

  • The pseudocode was not well defined. More explanations and logical flow are needed.
  • Citations need to be included in the punctuation like period.
  • Since this is a modified version of Adam, a comparison with Adam is needed for the numerical example.
  • A machine learning case is needed since this is an algorithm designed for machine learning models.

FTRL algorithm

  • It is very difficult to clarify different levels of subtitles based on the text.
  • References were not well formatted. For example, "[1]" is added to many references with no meaning.
  • Some symbols used in the equation lack explanations.

LossscaleOptimizer

  • More citations are needed for supporting the statement and applications.

Nadam

  • The result figures of the numerical example have not been placed in the proper place.
  • The numerical example and application parts are still not representative of illustrating NDAM's performance for machine learning models.

Beyesian optimization

  • Citation form (in text) should be double checked.

Genetic algorithm

  • Please provide some citations for supporting your statement (e.g. in Introduction)

Simulated annealing

  • Once the abbr. is defined please use it throughout the context (e.g. SA)
  • Avoid using pronouns (e.g., we) in scientific writing.

Particle swarm optimization

  • The caption was missed for the iteration results.

Differential evolution

  • Once abbreviations are introduced, please make sure the full term do not appear throughout the context.
  • Visualization section is not necessary. Figures should be embedded in the Wiki page.
  • Conclusion and References sections should not belong to Application section.
  • References are already shown at the bottom of the page. The extra list should be removed.