2021 Cornell Optimization Open Textbook Feedback

From Cornell University Computational Optimization Open Textbook - Optimization Wiki
Revision as of 15:07, 5 December 2021 by Asa273 (talk | contribs) (→‎Momentum)
Jump to navigation Jump to search

Lagrangian duality

  • Author list, sections and TOC
  1. Section titles should not be "bold". Please double check using source editor and avoid HTML formatting on the section titles.
  2. Remove cornell ID from Author list
  • An introduction of the topic
  1. This section includes sentences on constructing the dual problem and is referred to as Lagrangian relaxation (LR). This is incorrect, please fix the definition of LR.
  2. Definitions of LR and its relation to duality should be double checked and re-written.
  3. Only one reference is present in this section. Please add more relevant references by expanding this section.
  4. Consider merging the “introduction” and “history” sections.
  5. In the titles, please change the font from bold to normal to have consistent formatting in the site.
  • Theory, methodology, and/or algorithmic discussions
  1. The Lagrangian variables associated with equality constraints h(x) are unbounded but the Lagrangian dual problem states them as non-negative. Please fix the same.
  2. Also to construct a dual, we do not change minimization to maximization directly. We observed such things in the examples in lecture notes due to simplification. The lagrangian dual problem would be minimize (,).
  3. Adding to the previous point, the Lagrangian is a lower bound on the original objective; the solution to the primal and dual or only equivalent if the duality gap is 0. You reference this in one section, but this is after your statement “Hence, solving the dual problem, which is a function of the Lagrangian multipliers (𝜆*) yields the same solution as the primal problem, which is a function of the original variables (x*). “. Please clarify the specific conditions that must hold for the solution of the dual to be equal to the primal’s.
  4. You refer to the “Complementary Slackness Theorem”, but don’t actually write the mathematical representation of complementary slackness. Please fix this. Also consider including the derivation of the complementary slackness condition, as it is both easy and short. Boyd is a good reference for this.
  5. Last step of the “process” subsection also needs updating according to the previous comments.
  6. The inline notations should also be typed using LaTex.
  7. Please use the LaTex code or equation editor for min, s.t., etc.
  • At least one numerical example
  1. Only one dual variable is associated with each constraint. The numerical example uses two for the first and second constraint which is unnecessary. Please update it accordingly for both constraints. This particular example will only have two dual variables instead of the five dual variables used currently.
  2. All consecutive steps need to be updated since the dual variables would be updated.
  3. After substitution the nonlinear function should be further simplified. The current expression reads like a highly nonlinear function but can be easily simplified.
  4. Similar to the comments in the methodology section, inverting minimize to maximize is incorrect. Please update the dual objective function and domain of dual variables accordingly.
  5. Please use the LaTex code or equation editor for min, s.t., etc.
  • A section to discuss and/or illustrate the applications
  1. Bullet points could be used to state the last four real-world examples that explain the physical meaning of the primal and dual problems.
  2. Add references for the last set of applications.
  • A conclusion section
  1. This section contains a few typos. Please fix the same.
  • References
  1. Some citations' hyperlinks are displaying.

Disjunctive Inequalities

  • Author list
  1. Missing course section and semester
  2. Remove cornell ID
  • An introduction of the topic
  1. No citations are present in this section.
  2. “mixed-integer programming (MIP)” should be used instead of “multiple integer programming (MIP)”. Please fix this error.
  • Theory, methodology, and/or algorithmic discussions
  1. The abbreviation MILP is not previously defined. Please fix this issue.
  2. You consistently use the negative sign instead of the NOT operator for y (-y instead of ¬y).
  3. Some inconsistencies with the spacing of variables, constraints, etc., under the “General” section that need to be fixed.
  4. Typo in “This is shown below by M1, M2, y1, and y1:” where y1 needs to be changed to y2. Why use two different Big-M variables here? Elsewhere in the Wiki you only use one so this could lead to confusion with a general audience. Also if this was taken from the lecture notes then it needs to be cited.
  • At least one numerical example
  1. Please reformulate and solve a complete numerical example rather than just reformulating a general example. Demonstrate the use of Big-M and Convex Hull formulation in an optimization problem that provides details such as individual steps in the problem solving process and final results.
  2. Add space between vee (V) operator and brackets in first line of Latex
  3. Please format variables correctly, for example, use instead of x1.
  • A section to discuss and/or illustrate the applications
  1. Please format the equations appropriately either by using latex code or the visual editor. These images are NOT acceptable!
  • A conclusion section
  1. There is no conclusion presented in this section at all.
  • References
  1. The included references have NOT been used anywhere in the Wiki. Add references for sentences that are not common knowledge and please link them appropriately with the text in Wiki. If the figures used here were not original works, you must also cite them.
  2. There are many papers on this topic. A simple Google (Scholar) search could provide you with sufficient references to cite.
  3. Many important references of this topic are missing.
  4. Please consider linking the references as demonstrated in the Wiki tutorial on Canvas and in this template,  https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Stochastic Programming

  • Author list: Remove cornell IDs
  • An introduction of the topic
  1. Place references after the period at the end of each sentence. This goes for all the sections in the wiki.
  2. This section only includes two sentences on Stochastic programming (SP), while the rest gives examples of uncertainty. Please discuss the need for SP in the presence of uncertainty. Also, discussion on robust optimization and its limitations should be removed since it is out of place.
  • Theory, methodology, and/or algorithmic discussions
  1. Please avoid direct inline linkbacks to Wikipedia.
  2. The symbol “xi” in the methodology subsection should be explained.
  • At least one numerical example
  1. Copying a numerical example "entirely" from a textbook is inappropriate. Your team should come up with a "numerical" case.
  2. No specific application context is needed for a numerical example.
  3. The inline notations (`x1`, `s1`) should also be typed using LaTex.
  4. Label all tables with a table number for better readability.
  5. Properly format the solution table with the label attached rather than the following sentence. The solution table looks different from the others, please fix this for consistency.
  • A section to discuss and/or illustrate the applications;
  1. I suggest eliminating citing the last name of the first author (i.e. Zhou et al.)
  • A conclusion section
  • References
  1. URLs of some citations are not properly formatted (not showing the hyperlinks).

Exponential Transformation

  • Author list
  1. Missing course section
  2. Remove cornell ID
  • An introduction of the topic
  1. Please expand the introduction.
  2. Please aim for a maximum average sentence length of ~25 words. Last sentence with 51 words is hard to read.
  3. Second Sentence: please change the word “they” as it could make the meaning ambiguous
  4. If you cite an example on the page, as in the last sentence, please provide a link to move the reader to the section/subsection.
  5. If you use abbreviations, please introduce them (e.g. NLP,MINLP)
  • Theory, methodology, and/or algorithmic discussions
  1. Please explain the transformation in words along with equations
  2. Terms like posynomial should be described in detail.
  3. Please move the numerical example to the section below
  4. The “(eq 1)” is not needed here.
  5. Please expand this section.
  • At least one numerical example
  1. In the third equation of the numerical example, it is confusing to have coefficients after numbers. Some readers may read it as an exponent.
  2. Last equation in this section after “further linearization” is incorrect. This equation cannot be further linearized, please fix this.
  3. Please explain the steps in the numerical examples in detail. The step-by-step solution should be provided.
  4. Please ensure that the example : (1) is NOT directly taken from a book, and (2) a step-by-step solution should be provided, showing every intermediate steps.
  • A section to discuss and/or illustrate the applications
  1. Missing part of text: “Proof of convexity of with positive definite test of Hessian…”
  2. Applications are not numerical examples. Please refer to this link for example of applications: https://optimization.cbe.cornell.edu/index.php?title=Duality
  3. Citation 7 is missing in current applications
  4. The section current applications is redundant
  5. Please use the LaTex code or equation editor for min, s.t., etc.
  6. Under current applications, do not just use a hyperlink to describe an application. Actually describe it. And properly inline citation style should be used instead of the hyperlink.
  7. The convexification application of MINLP can be further simplified for binary variables. Please refer to the lecture slides for more information.
  • A conclusion section
  1. If you cite an example on the page, as in the last sentence, please provide a link to move the reader to the section/subsection.
  • References
  1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Citation 7 is missing in current applications

Sparse reconstruction with Compressed Sensing

This Wiki needs a significant rewrite. Please go through the comments for details.

  • An introduction of the topic
  1. The introduction section should include information about the problem and its implications presented briefly. Please use full sentences to write this Wiki. You may use tools like Grammarly to check sentence formation and grammar.
  2. This section includes several typos like “sub modual”. Please fix them throughout the wiki and delete them if not required.
  3. Many abbreviations are used before previously defining them. Please define these abbreviations before using them in the text.
  4. This section is incomprehensible in its current form. Please rewrite with proper comprehension.
  5. Equations and math symbols need proper reformatting. The current version reads like text (along with equations) copy-pasted from a specific source. All mathematical symbols and equations should be formatted via LaTex - this is a learning objective of the Wiki assignment. You can find some useful links on converting your equations/symbols into LaTex code here: (https://optimization.cbe.cornell.edu/index.php?title=Help:Contents).
  6. Try to place the figure at the top of the Wiki between the main text.
  7. Avoid pronouns such as “we”.
  8. I suggest the use of more formal abstract illustrations.
  • Theory, methodology, and/or algorithmic discussions
  1. Equations and symbols need proper reformatting.
  2. Lemmas and theorems are not expected for this Wiki. Sparse reconstruction is a straightforward concept but is unnecessarily complicated here. Please refer to other Wiki examples to get an idea of what the Wiki should convey.
  3. All equations need to be better formatted.
  • At least one numerical example
  1. Numerical example is missing.
  2. Every iteration should be clearly presented, and solved "step-by-step".
  • A section to discuss and/or illustrate the applications
  1. Having a list is not enough. Please explain at least three applications in a few sentences each.
  • A conclusion section
  1. Conclusion section is missing.
  • References
  1. The current reference list is not correctly formatted. References should be properly formatted, not just hyperlinks. Refer to the link below for an example: https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. More references should be added. A simple Google Scholar search would give you many references.

Portfolio Optimization

  • Author list
  1. Remove cornell id
  • An introduction of the topic
  1. The introductory sentence should be rephrased. The action of minimizing the risks does not inherently maximize the gains, rather PO aims to maximize gains whilst minimizing risks.
  2. Amount of whitespace can be reduced by changing the orientation of Figure 1 and the sentences in this section.
  3. Define terms such as risk, return, portfolio, etc., when you introduce them. Assume that the reader may not know much about finance. This goes for all other sections as well.
  • Theory, methodology, and/or algorithmic discussions
  1. A brief mention of modern portfolio theory (i.e.. Markowitz) would be appropriate in this section.
  2. Several grammatical errors here involving sentence structure and clarity. Some questionable semantics (e.g., “The portfolio optimization mainly assumes two directions.”) and syntax (phrases such as “.. is as follows” should be followed by a colon). Misuse of commas and missing commas in this section. Two sentences introducing E(rp) and w should be combined into one.
  3. Use LaTex to distinguish variables written within a sentence, such as m and n.
  4. Rephrase “Cut the relevant information and conditions in the portfolio optimization, as well as the final requirements into the relevant variables, constraints and linear functions of the linear programming problem.”
  5. An explanation of a few common constraints would be helpful, rather than just including a table.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. Solving the numerical example by GAMS is inappropriate. Please provide detailed step-by-step calculation results.
  3. All tables need to be labeled.
  4. Include figure number in label for consistency.
  5. Fix misspelling “dolling decision variables”.
  6. Use LaTex for all variables, equations, and constraints here.
  7. Example 2 table is hard to read, so making it bigger would help.
  8. Remove the “Using excel as the solver” part from the sentence before the solution discussion.
  9. Some grammatical errors here (phrases such as “.. is as follows” should be followed by a colon).
  • A section to discuss and/or illustrate the applications
  1. Rephrase “Portfolio optimization can be used to screen investment projects that meet investors, rationally allocate investment amounts, etc.”
  2. Not sure “relevant” is the correct word choice here.
  3. You need more specific examples with the utility of portfolio optimization, this section is quite general as is. Some more detail and focus on real-world applications in the financial industry that relate to retirement planning, financial security, economic stability, etc., would be helpful.
  • A conclusion section
  1. Need some commas here.
  2. The sentence “Linear programming has been around since the 1940’s and has such a wide base of applications” is not necessary.
  • References
  1. Please consider linking the references as demonstrated in the Wiki tutorial on Canvas and in this template,  https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Remove white space between end of sentences and reference numbers.

Chance constraint method

  • Author list:
  • An introduction of the topic
  1. Please consider correcting a few grammatical errors: “pre-planned for”, “god”, “certain levels of feasibility is guaranteed in what are”, and “Performance of a system”
  2. In “Chance-constraint”, it is capitalized randomly throughout the introduction. Please correct.  
  3. Please use technical language to briefly introduce chance-constrained programming. Words like “acts of god”, “cost of doing business” are not appropriate for a  technical Wiki.
  • Theory, methodology, and/or algorithmic discussions
  1. Please add a citation to the first sentence.
  2. Xi is an uncertainty/randomness variable. It is better to use clear language.
  3. Please use the mathematical editor for adding explanations in the text. Using “ x is a decision variable” is hard to read. Same for f(x) and others.
  4. Theory is insufficient. Please expand and explain different approaches.
  5. Please add pros and cons explicitly as a list.
  6. Explain the physical meaning for examples of chance constraints along with all the notations used.
  7. Please ensure that the example : (1) is NOT directly taken from a book, and (2) a step-by-step solution should be provided, showing every intermediate steps.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. Please remove this example as it is directly from this book. The example should be purely numerical without any background.
  3. Please use the equation editor for min, st., etc.
  4. Please use the mathematical editor for adding explanations in the text. Using “ x is a decision variable” is hard to read. Same for f(x) and others.
  5. Please change the table format so as not to confuse the reader.
  6. Multiple instances of [Chart to be added] are missing.
  7. Example is incomplete.
  8. Avoid pronouns such as “we”.
  • A section to discuss and/or illustrate the applications
  1. Please connect several grammatical and spelling errors: “real life application”, Energy creation, particularly in renewable sources, have high variabilities”, and others
  2. “Zhao, Xue, Cao, and Zhang”. No need to list all authors within the article. Provide a reference is sufficient. If authors must be mentioned, (Zhao et al.) should be ok.  
  • A conclusion section
  1. Uniqueness and universality earlier are not clear to me. If they are not discussed earlier in the application, it would be better not to introduce new discussions in the conclusion.
  2. If you cite an example on the page, as in the last sentence, please provide a link to move the reader to the section/subsection.
  • References
  1. References seem to vary in format. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. More references should be added. A simple Google Scholar search would give you many references.

Bayesian Optimization

  • Section titles should not be "bold". Please double check using source editor on the section titles.
  • Contents: Subheadings for EI and the algorithm should not be bolded, Random words should not be capitalized.
  • Author list: Remove cornell ID, Please check names
  • Introduction
  1. The introduction is too general and not substantial enough. For example, simply saying BayesOpt is useful when the objective function is unknown obscures exactly HOW it is useful (namely, computational efficiency in applications where ground truth sampling is expensive). Discussion on applications should be moved to a separate section.
  2. Machine learning rarely includes black-box functions to be optimized. Bayesian optimization is almost never used for optimizing ML loss functions but can instead be used for hyperparameter optimization. Please update such claims in this section.
  • Theory, methodology, and/or algorithmic discussions
  1. Captions need reformatting.
  2. Consider italicizing keywords rather than bolding.
  3. Please add a citation to the first sentence.
  4. Discussion on acquisition functions should include comparisons, tradeoffs, and reasons to use one over the other. Should also note that expected improvement is the most widely used in practice, and explain.
  5. Avoid pronouns such as “we”.
  6. Please write equations in the Wiki instead of attaching images for equations.
  7. Acquisition function figure could be made larger and clearer to improve readability.
  • At least one numerical example
  1. Any references to functions or methods in code ‘e.g. fmin’ should be properly formatted as code-stylized text.
  2. Please use the equation editor for min, st., etc.
  3. Avoid including a figure of the code for this example and explicitly describe the steps to the modeling and solution process instead.
  4. Avoid pronouns such as “our” and “we”.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  1. Please do not use brackets to enclose lists.
  2. Some claims here should be supported by references. Please cite each source after its sentence.
  • References
  1. References should be properly formatted, not just hyperlinks. Refer to the link below for an example: https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Try to avoid references to “pop” machine learning blogs where anyone can be an author. (e.g. towardsdatascience)
  3. All references are URLs. Please cite publications and literature.
  4. A simple Google Scholar search would give you many references.

Notes on grammar: Needs some work. Several instances where colons are inappropriately inserted mid sentence or in subheadings. Explanations are not terse. Several instances of switching between personal and impersonal style of writing, which is distracting.

Conjugate gradient methods

  • Author list: Remove cornell ID
  • Introduction
  1. All inline notations (e.g., `x`, `A`) should be typed using LaTex.
  • Theory, methodology, and/or algorithmic discussions
  1. All equations need to be better formatted.
  2. Is Gauss-Newton no longer referenced?
  3. Theorems listed in the first section should be accompanied with high level explanation, not just a list of the theorems themselves. The page should read like an article, with proper flow.
  4. Please indent equation blocks.
  5. Please properly format pseudocode.
  • At least one numerical example
  1. Steps should be accompanied with explanation, or reference to the corresponding step in the pseudocode.
  2. Please properly format in a more organized manner, aligning equations appropriately and demarcating steps appropriately.
  • A section to discuss and/or illustrate the applications
  1. Consider including 2 additional examples of applications
  • A conclusion section
  1. Consider adding future research directions
  • References
  1. Reference primary sources rather than Wikipedia
  2. Too few references.
  3. More references should be added. A simple Google Scholar search would give you many references.

Geometric Programming

  • Author list
  1. Remove cornell ID
  • An introduction of the topic
  1. Examples of applications in this section use the same reference. Please cite their individual sources.
  • Theory, methodology, and/or algorithmic discussions
  1. The symbol denoting the domain in the definition of a monomial is unclear. Please clarify it or fix this if it is incorrect.
  2. Definition of posynomial refers to section 2.1 which is missing from the Wiki (sections are not numbered in the main text).
  3. In the generalized posynomial subsection, bullet points do not tell us why h(x) is posynomial. Either provide reasons or simply state that h(x) is posynomial. Also explain why h3 is a generalized posynomial.
  4. Additional theory on the feasibility analysis could be provided in this section.
  • At least one numerical example
  1. In the transformation example, the last two constraints could also be simplified by applying a natural logarithm on both sides. Please update them as well.
  • A section to discuss and/or illustrate the applications
  1. The figure in this section needs to be labeled.
  2. The figure needs to be resized and perhaps aligned to the center.  
  • A conclusion section:
  1. Please avoid vague language such as: “This makes”.
  2. Please avoid opinionated statements: “one of the best ways”.
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. This Wiki has very few references. A quick Google Scholar search may provide relevant references.

Adam

  • Author list
  • An introduction of the topic
  1. Some grammatical errors here, mostly related to the need for commas in certain places (e.g., “Before Adam..”).
  2. Some minor errors with parts of speech throughout the section, need to revisit phrases such as “which has broader scope in future for”, etc.
  3. Try splitting up some of the longer sentences in this section, a couple are hard to read.
  4. Avoid definitive statements about Adam being the best or always better solver, as this is simply not true (the choice of the “best” optimizer is setting-dependent). Use language such as “Research has shown that Adam has demonstrated superior experimental performance over..” and then cite academic references to back this claim.
  5. What does adam stand for? Introduction is insufficient. Please expand.
  • Theory, methodology, and/or algorithmic discussions
  1. Revise grammar here, noticing some missing commas and uncapitalized word after period.
  2. Rephrase “second one is to update the old position with the updated position”.
  3. Use LaTex code or equation editor to display all equations and variables in this section, and actual subscripts instead of “m_t”, etc.
  4. Avoid inserting inline citations after words like “According to..” or “This article..” as it is a bit informal. This could be rephrased or changed to something like “According to author,^[2] …” with author name inserted.
  5. Remove white space before the period in RMSP discussion.
  6. Please provide a pseudocode.
  7. Please use list the two methods here “Adam is a combination of two gradient descent methods which are explained below”
  8. Please expand the theory section significantly. Theoretical convergence properties should be discussed, even if briefly.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  • A section to discuss and/or illustrate the applications
  1. Same comment as before, consider replacing inline citations after words like “According to..”.
  • A conclusion section
  • References
  1. References should be properly formatted, not just hyperlinks. Refer to the link below for an example: https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Try to avoid references to blogs and use peer-reviewed academic references instead.
  3. Too few references.
  4. More references should be added. A simple Google Scholar search would give you many references.

a* algorithm

  • Author list: Remove cornell ID
  • Section titles should not be "bold". Please double check using source editor and avoid HTML formatting on the section titles.
  • An introduction of the topic:
  1. Weird spacing between paragraphs. Please fix this issue.
  2. In the titles, please change the font from bold to normal to have consistent formatting in the site.
  3. Please consider correcting a few grammatical errors: “Optimal path”, “cross country”, missing period at end of first paragraph, other random capitalizations, etc.
  4. There are no citations in the introduction. Please cite every source.
  • Theory, methodology, and/or algorithmic discussions
  1. Please add the mathematical description of the algorithm.
  2. Reference style varies in sentences. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  3. Please fix grammatical and spelling errors as (“from current position to the goal”, “There are a lot of discussions”, etc). Also, many hyphens are missing as “non playable”.
  4. In algorithms, it is a standard to add high-level description (i.e. pseudocode or flowchart). Please incorporate it.
  5. Use LaTex code or equation editor to display all equations and variables in this section (e.g., “f(n)...”, “h(n)..”, etc.). This goes for other sections as well.
  • At least one numerical example
  1. The numerical example does not show the full computations the algorithm performs. Please show the computation on a smaller example.
  2. Instead of writing things like “The above image..”, label each figure and use the figure number to refer to it in text.
  3. Please ensure that the example : (1) is NOT directly taken from a book, and (2) a step-by-step solution should be provided, showing every intermediate steps.
  • A section to discuss and/or illustrate the applications
  1. No references in the applications. Please cite every source
  2. Preferably, add at least an additional application.  
  • A conclusion section
  1. Conclusion should summarize descriptions. Please modify it to provide a summary.  
  2. Please pay attention to the length and structure of sentences here and in the full page. First sentence is hard to read.
  • References
  1. References seem to vary in format and are not linked correctly. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Incorrect reference style. Please follow the example and use the template.

Job-Shop Scheduling Problem

  • An introduction of the topic
  1. The current introduction to the jobshop scheduling problem has only two sentences in addition to the parameter description. Introduction typically contains information about the problem, its importance in the real-world, and some information about the solution techniques and their types to solve the problem. Please add some information that covers the above.
  • Theory, methodology, and/or algorithmic discussions
  1. It is unclear whether the assumptions stated in this section are required to apply the following solution techniques. Please clarify the same. Also use complete sentences to state them.
  2. The branch and bounds method described in this section only discusses the solution technique for problems with one machines. However, branch and bound is a general technique that can be applied to any MILP problems with varying scales. Please update the “methods” section to be as general as possible.
  3. Since this Wiki focuses on jobshop scheduling, at least two methods are expected. Branch and bound is a general MILP technique, so, it is recommended to add a tailored technique that can only solve specific jobshop scheduling problems. Solving the numerical example with this technique is not necessary.
  4. Reference to the branch and bound technique described in this section is a “youtube” video. Please add references in literature that describe this method in detail. The method used in this video is highly tailored for a single machine application. This is also an incorrect way to cite a reference. Please keep this section as general as possible.
  5. Use LaTex code or equation editor to display all equations and variables in this section and all other sections as well.
  6. Check grammar in this section. For example, phrases like “are as follows” need to be followed by a colon and not a period.
  7. Consider rewriting the assumptions as a list in this section.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. The example used in this section is exactly the same as the one in the youtube video. Please use a modification of this example or choose another example/method to demonstrate the solution technique. Your team should ideally create a numerical example independently. If you take a numerical example directly from a particular source, you will need to get explicit permission from the textbook author in writing and share that written permission with the instructors.
  3. The figure in this section is not numbered when all others are. Relabel this figure for consistency and its number to refer to it in-text.
  4. A numerical example should be simply "numerical" and does not need any application context (similar to those numerical problems in HW assignments).
  • A section to discuss and/or illustrate the applications
  1. This section should only focus on real-world applications of the jobshop scheduling problem. But currently, this section includes additional information on solution techniques/complexity that is appropriate for the Introduction section. Please discuss the applications of the problem in this section.
  • A conclusion section
  1. The meaning of  “Operations applications” is unclear. Please explain or update if necessary.
  2. The current conclusion section does not properly summarize the problem. Please refer to other Wiki examples for an idea to update the section accordingly.
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Please reference media sources like reference 5 appropriately.
  3. A simple Google Scholar search would give you many "formal" references.

Optimization in game theory

  • Author list: remove cornell IDs.
  • An introduction of the topic
  1. References are not linked. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  • Theory, methodology, and/or algorithmic discussions
  1. Why only a subsection on "Nash Equilibrium" is included in "Theory" section? Please re-format.
  2. Please edit references.
  3. Add a mathematical description of the problem and a pseudocode/flowchart for the Lemke-Howson algorithm.  
  4. Rephrase “This algorithm utilizes iterated pivoting much like the simplex algorithm used in the simplex algorithm used in linear programming”.
  • At least one numerical example
  1. Please organize the last part in a more readable format. Questions may be in bold and numbered, answers are more direct, etc.
  2. Remember to cite all images and tables.
  3. Please ensure that the example : (1) is NOT directly taken from a book, and (2) a step-by-step solution should be provided, showing every intermediate steps.
  • A section to discuss and/or illustrate the applications
  1. Very good, link the reference and cite all sources.
  • A conclusion section
  1. Please add more summarizing especially from theory sentences and avoid long sentences.
  • References
  1. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Reference primary sources rather than Wikipedia
  3. Incorrect reference style. Please correct.

Trust-region methods

  • Author list:
  1. Remove cornell IDs. Author is also spelled incorrectly.
  2. Add the course section.
  • An introduction of the topic
  1. References are not linked. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Use LaTex code or equation editor to display all equations and variables (e.g., “xk”, “f`”, etc.) in this section and all other sections as well.
  3. Avoid pronouns such as “we”. This goes for all other sections as well.
  • Theory, methodology, and/or algorithmic discussions
  1. Organization of ideas in this section needs work.
  2. You have not defined explicitly why the Cauchy point is important to compute beyond a vague allusion to performance improvements, which is also wrong (it is useful because of its guarantees for convergence, not performance) It is also misspelled.
  3. Each approach should have accompanying explanation and motivation for why it is being discussed. It is not enough to outline the algorithm.
  4. Please make sure symbols are properly subscripted and superscripted (e.g. “pk” should be “p_k”
  5. Please format the algorithm in proper algorithmic pseudocode format.
  6. Little to no discussion on global convergence guarantees
  7. Please include discussion about the advantages and disadvantages of the algorithm
  8. Fix typo “couchy point”.
  • At least one numerical example
  1. Any code functions (uminfunc) should have proper text formatting.
  2. The graph needs a better caption explaining how the axes are labeled and what data points are being shown.
  3. Please increase the quality of the figure. It is hard to see the red line.
  4. Add citation to “The Rosenbrock function is a non-convex function, introduced by Howard H. Rosenbrock in 1960, which is often used as a performance test problem for optimization algorithms.”
  • A section to discuss and/or illustrate the applications
  1. The content in this section as it is currently does NOT describe applications, but rather different approaches within the trust region methodology. Please provide specific applications (e.g. TRPO in reinforcement learning).
  • A conclusion section
  1. Please add more summary, future research directions for example is a good start.
  • References
  1. Incorrect reference style.
  2. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  3. More references should be added. A simple Google Scholar search would give you many references.
  • There are numerous misspellings, grammatical errors, and incorrect claims. Please fix these.

Momentum

  • Author list
  1. Remove cornell ID
  • An introduction of the topic
  1. Apart from an explanation on momentum, it is necessary to briefly point out the limitations of SGD and why momentum could help with these limitations. Please update it accordingly.
  2. Remove bold on “Momentum”.
  3. Place references after the period at the end of each sentence. This goes for all the sections in the wiki.
  • Theory, methodology, and/or algorithmic discussions
  1. Equation formatting is very poor and should be formalized.
  2. It is important to use technical language for this Wiki. Although a layman’s explanation is appreciated, it would be better to skip using words like “zig zagging”. Try to explain all concepts in a technical language with few simplifications but NOT vice versa.
  3. The definition of the update rule for SGD with momentum looks incorrect, specifically the first expression. Please fix it and also explain all the parameters used.
  4. Use LaTex code or equation editor to display all equations and variables (e.g., “W”, “V`”, etc.) in this section and all other sections as well.
  5. Avoid pronouns such as “you”.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step". Since writing all iterations is not feasible, at least present a few iterations for both cases.
  2. Please try to label the plots that explains what each line color means.
  3. Starting point for SGD with momentum is different in explanation and the table. Please fix the same.
  • A section to discuss and/or illustrate the applications
  1. Please use correct terminology like “optimizing non-convex functions” and not “training non-convex models”.
  2. Adam, Adadelta, and RMSprop are variants of SGD that already use momentum. Please double check the writing and update if necessary.
  • A conclusion section
  1. Please refrain from using words like “zig zag” effects.
  • References
  1. Almost all references used are URLs. Please try to add journal/conference articles or books for references, instead of directly citing the URLs. Please check the list below and run a quick Google (Scholar) search to identify relevant literature.

Stochastic Dynamic programming

  • Author list
  1. Remove cornell ID
  • An introduction of the topic
  1. Discussion on applications should be moved to a separate section.
  • Theory, methodology, and/or algorithmic discussions
  1. Remove the grey box background of equations.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Outer-approximation

  • An introduction of the topic
  1. See formatting guideline below
  2. Avoid opinionated statements such as “MINLP problems are usually the hardest to solve”.
  3. Rearrange the text such that the MINLP formulation is in the theory section and keep the introduction in words only.  
  • Theory, methodology, and/or algorithmic discussions
  1. Consider left aligning equations and optimization problem formulations by the “=”. See https://optimization.cbe.cornell.edu/index.php?title=Stochastic_programming for an example
  2. The sentence “The Outer-Approximation (OA) algorithm was first proposed by Duran and and Grossmann in 1986 to solve MINLP problems.” needs a reference.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. “Minimize” and “subject to” should be “min” and “s.t.” in MathType
  • A section to discuss and/or illustrate the applications
  1. Does not explicitly point out why OA is applicable (and/or preferred) in these applications, rather than other MINLP approaches (show that the problem formulations are amenable to a solution approach through OA)
  2. The sentence “... an active research area and there exists a vast number of applications in fields such as engineering, computational chemistry, and finance.” needs references.
  3. Place GAMS code in a single code box or remove it.
  4. Consider reformatting to make steps more readable. Inserting spaces and breaking down steps would help.
  • A conclusion section
  1. Too short. Consider discussion on future research direction and discussion on uncertainty
  2. Please review abbreviations throughout the page. Why is MINLP redefined here? “Outer-Approximation is a well known efficient approach for solving convex mixed-integer nonlinear programs (MINLP)”.
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Remove "Template:Reflist"

Unit commitment problem

  • Author list
  • An introduction of the topic
  1. Please expand the introduction and avoid discussions of examples or specific applications in this section.
  2. The sentence “Nonlinear, Non-convex programming optimization problem.” doesn’t make sense by itself and Non-convex shouldn’t be capitalized.
  • Theory, methodology, and/or algorithmic discussions
  1. Figure/image format should be revised to better display the content.
  2. Uppercase characters are used randomly (e.g., “non-convex transmission Constraints”) . Please follow correct language conventions for sentence structure.
  3. Avoid inserting inline citations after words like “written in matrix form as equation [3]..” or “presented in [3]...” as it is a bit informal when you don’t explicitly name the subject. Also these two sentences are grammatically incorrect and appear to be missing an ending period and comma, respectively.
  4. Don’t say “written in matrix form as equation..” and just cite the reference, actually write out the equation.
  5. Properly label the figure in this section with a figure number and improve visibility by making it larger.
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. Label the figures in this section properly with figure numbers.
  3. Fix typo “while minimize” to “while minimizing”.
  4. Avoid pronouns such as “we”.
  5. Use the equation editor when typing equations.
  • A section to discuss and/or illustrate the applications:
  1. I suggest changing the order of the subtitles here. For example, Single-Period Unit Commitment.
  • A conclusion section
  • References

Frank-Wolfe

  • Author list:
  • An introduction of the topic
  1. I suggest highlighting disadvantages along with advantages.
  • Theory, methodology, and/or algorithmic discussions
  1. “[n x 1] matrix” please use the equation editor to express mathematical descriptions and symbols (p,b, etc)
  • At least one numerical example
  1. Every iteration should be clearly presented, and solved "step-by-step".
  2. Please show at least a few iterations. Even for smaller examples if needed. Report the final solution.
  3. Please use the LaTex code or equation editor for min and include s.t., etc.
  4. Please ensure that the example : (1) is NOT directly taken from a book, and (2) a step-by-step solution should be provided, showing every intermediate steps. For your example, please explicitly state that the derivative is taken etc.
  • A section to discuss and/or illustrate the applications:
  • A conclusion section
  1. Same as the introduction. Pros and cons should be evaluated together!
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Line Search Method

  • Author list
  • An introduction of the topic
  1. Expand the introduction and avoid discussion on some of the specific steps in the solution process.
  2. Provide references here.
  • Theory, methodology, and/or algorithmic discussions
  1. The phrase “are as follows” in the steepest descent method discussion needs to be followed by a colon.
  2. Rephrase “has a nice convergence theory” and cite a reference for this claim.
  3. Avoid pronouns such as “we”.
  4. Add citation after “.. proposed by Phillip Wolfe in 1969.”
  5. Figure 1 is between two sections. Please fix this issue.
  • At least one numerical example:
  1. Add some space between iterations or subsection break
  • A section to discuss and/or illustrate the applications:
  1. Too few references in this section.
  2. Last paragraph makes some claims without references.
  • A conclusion section
  • References
  1. References should be properly formatted. Refer to the link below for an example: https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. More references should be added. A simple Google Scholar search would give you many references.

Piecewise Linear Approximation

  • Author list
  • An introduction of the topic
  1. The content of this section is good, but there are some issues with sentence clarity and some other grammatical errors. Please revisit this section and make changes accordingly.
  • Theory, methodology, and/or algorithmic discussions
  1. Fix typo “to force the x’ values become associated with”.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  1. Please aim for a maximum average sentence length of ~25 words. Some of these longer sentences are hard to read.
  • A conclusion section
  1. Expand the conclusion section to be longer than one sentence. The conclusion section to include a brief summary of what was discussed above, an emphasis on it’s significance, and a brief discussion of future extensions and research direction if applicable.
  • References
  1. Include hyperlinks to sources when possible.

Mathematical Programming with Equilibrium constraints

  • An introduction of the topic
  1. This section includes several terms like variational inequalities, constraint qualifications that were not discussed in the class. Please add a sentence to explain them before using them.
  • Theory, methodology, and/or algorithmic discussions
  1. The meaning of parameter vector x is unclear. Please add more information or update if necessary.
  2. Equations and symbols in the PIPA subsection are not formatted correctly. Please use the same formatting for all equations, so they read as mathematical equations and not text. This goes for all other sections as well.
  3. Use equations instead of images to represent math programs and equations in the Implicit Descent and SQP subsection.
  4. Apart from the steps for each solution technique, please also add a few sentences that describe each method.
  • At least one numerical example
  1. Please define the terms like NCP, MP before abbreviating them. Also try not to unnecessarily abbreviate simple terms.
  2. Equations should be typed by LaTex. Images for equations are unacceptable.
  3. GAMS code is strongly discouraged. Please solve the problem "step-by-step".
  4. The selected numerical example is fine but is directly solved with the MPEC solver in GAMS. Try to solve it manually like the homework/in-class problems step by step using the steps described in the previous section by choosing any of the methods.
  5. Avoid using figures in the equations (subject to etc)
  • A section to discuss and/or illustrate the applications
  1. Add references to “power management, highway pricing, chemical process engineering, and traffic planning.”
  • A conclusion section
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Wing shape Optimization

  • Author list: Remove cornell ID
  • Sections: Section titles should not be "bold". Please double check using source editor to avoid weird format of the TOC.
  • An introduction of the topic
  1. The introduction is missing several references (e.g., “software packages like computational fluid dynamics..”, sentences containing things that aren’t common knowledge, performance claims, etc.)
  2. Avoid discussion involving finer details of subject methods in this section.
  3. In the titles, please change the font from bold to normal to have consistent formatting in the site. Same applies to box of content!
  • Theory, methodology, and/or algorithmic discussions
  1. Properly cite the CFD package, don’t just include a link.
  2. Properly label the figure with a figure number.
  3. Consider removing white space between isolated sentences to improve readability.
  • At least one numerical example
  1. If you’ve already defined an abbreviation (CFD), there is no need to define it again. Just use the abbreviation.
  2. Avoid pronouns such as “we” or “they”.
  3. Phrases like “under the following” need to be followed by a colon.
  4. Properly label the figure with a figure number and consider making them larger to improve visibility. Call the reader's attention to the figures in text by referencing the figure number.
  5. “As seen in the video below” is stated yet there are only images present and it may be initially unclear to the reader which figure is being referenced here.
  6. Avoid inserting inline citations like “[4] introduces an..”  as it is a bit informal when you don’t explicitly name the subject.
  7. Don’t just cite the reference when discussing the problem formulation, explicitly write the model formulation and solution process using LaTex or equation visual editor.
  • A section to discuss and/or illustrate the applications
  1. Some characters are randomly capitalized in this section.
  • A conclusion section
  1. These variables should be defined before the conclusion section, they are out of place here. Also, please use normal text when explaining variables except for the variable symbol.
  • References
  1. Include hyperlinks to references if possible. Please consider having the references appear as in this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Interior point method for NLP

  • An introduction of the topic:
  • Theory, methodology, and/or algorithmic discussions
  1. Primal-Dual formulation and comparison to the Barrier Method is not discussed.
  2. Include brief discussion about big O convergence rates.
  3. Need discussion about the concept of “central path” and the notion of self concordance
  4. Please consider proper formatting of the algorithm as pseudocode. Algorithms also must be accompanied with high level summary and discussion on its most important high level ideas.
  5. Graphs and images are incorrectly formatted to the page. Consider proper alignment with respect to the text body.
  6. Use explicitly typed Latex equations instead of images to represent math programs and equations.
  7. Fix typo “optimisation”.
  8. Use LaTex code or equation editor to display all equations and variables (e.g., “xi ”, “μ”, etc.).
  • At least one numerical example:
  1. There are formatting issues with figures 2,3. Please make sure to embed them within their respective sections.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  1. Minor character code typos in the conclusion.
  2. Also, please add more discussion in this section. Future research directions is a good start.
  3. There is a box "􏰐"
  • References

Adagrad

  • An introduction of the topic:
  • Theory, methodology, and/or algorithmic discussions
  1. Include discussion on its variants (most important is AdaDelta).
  2. Include disadvantages of Adagrad, since this provides motivation for the discussion on the variants and improvements of Adagrad
  3. Include comparisons to other popular optimizers (particularly important is comparisons to regular SGD and Adam)
  4. Different convergence rates are possible depending on the setting where Adagrad is used, but this is not mentioned on the page currently. As such the regret bound section should be more thoroughly explained.
  • At least one numerical example
  1. In the first sentence, “..take the following numerical example” should be followed by a colon.
  2. Fix typo “trayectory”.
  • A section to discuss and/or illustrate the applications
  1. This section is too short; include specific applications in which input features are sparse and Adagrad excels.
  2. Add reference to the claim “Mainly, it is a good choice for deep learning models with sparse input features”.
  • A conclusion section
  • References
  1. Too few references overall, you should aggregate information from multiple sources (even if the base algorithm itself comes from a singular paper)

McCormick Envelopes

  • Author list: OK but I suggest removing NetID
  • Sections: Section titles should not be "bold". Please double check using source editor to avoid weird format of the TOC.
  • An introduction of the topic
  1. First sentence is hard to read. Please consider keeping sentences below 25-30 words.
  2. No references provided. Please cite all sources.
  3. Figure 1 is provided in the middle between two sections. Please include in the introduction section.
  • Theory, methodology, and/or algorithmic discussions
  1. References are not linked or expressed correctly. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. When using mathematical expressions and symbols, please use the equation editor. (e.g., x*y, exy + y, sin (x+y) - x2)
  • At least one numerical example
  1. Please add a few sentences to show the transition from problem to solution.
  2. For the sample GAMS code, please place it in a code box
  • A section to discuss and/or illustrate the applications
  1. Having a list is not enough. Please explain at least three applications in a few sentences each.
  2. This section should be at least a paragraph to discuss relevant applications. Each application should be explicitly linked to the page topic. A few keywords do not meet the requirement at all.
  • A conclusion section:
  • References
  1. References are not expressed correctly. Please consider having the references as this Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
  2. Please follow the standard reference style - the current format is incorrect.
Retrieved from "https://optimization.cbe.cornell.edu/index.php?title=2021_Cornell_Optimization_Open_Textbook_Feedback&oldid=4780"