Difference between revisions of "2020 Cornell Optimization Open Textbook Feedback"

From Cornell University Computational Optimization Open Textbook - Optimization Wiki
Jump to navigation Jump to search
Line 167: Line 167:
  
 
* An introduction of the topic
 
* An introduction of the topic
*# No references present in this section.
 
 
* Theory, methodology, and/or algorithmic discussions
 
* Theory, methodology, and/or algorithmic discussions
*# The current version of the Wiki discusses only two cuts of the many types of cuts. This discussion is trivial in terms of both length of the article and quality of content. Please discuss a few other types of cuts in detail. Some of them are listed here, <nowiki>http://www-eio.upc.es/lceio/manuals/cplex-11/html/usrcplex/solveMIP14.html</nowiki>
 
*# Please reduce blanks between paragraphs.
 
*# Missing article “1. Begin with LP in standard form for application of simplex method.”
 
*# Add a hyphen to mixed-integer
 
 
* At least one numerical example
 
* At least one numerical example
*# Examples of cuts provided in the previous section do not count as a numerical example. Please actually solve a MILP problem using the generated specific cuts and the associated technique of pruning infeasible solutions of the MILP.
 
 
* A section to discuss and/or illustrate the applications
 
* A section to discuss and/or illustrate the applications
 
*# MILP and their solution techniques involving cuts are extremely versatile. Yet, only two sentences are added to describe their applications. Please discuss their applications, preferably real-world applications, in brief. Example Wikis provided on the website could be used as a reference to do so.
 
*# MILP and their solution techniques involving cuts are extremely versatile. Yet, only two sentences are added to describe their applications. Please discuss their applications, preferably real-world applications, in brief. Example Wikis provided on the website could be used as a reference to do so.
 
* A conclusion section  
 
* A conclusion section  
 
* References
 
* References
*# Add more references while making the above mentioned changes by citing appropriate sources.
 
*# Lecture notes may not be a credible reference. Please find the original source.
 
  
 
==[[Column generation algorithms]]==
 
==[[Column generation algorithms]]==
  
 
* An introduction of the topic
 
* An introduction of the topic
*# Use Times New Roman font for all headings and text throughout the Wiki.
+
* Theory, methodology, and/or algorithmic discussions.
*# No references present in this section.
 
*# Please avoid using “your”
 
* Theory, methodology, and/or algorithmic discussions
 
*# Please cite statements that are not common knowledge. Currently, zero references are present.
 
*# Significant whitespace present in the methodology subsection. Please consider reformatting to minimize this whitespace.
 
*# Several equations and notations are NOT correctly formatted. Please ensure that they are corrected accordingly.
 
*# Similar formatting mistakes are observed in the column generation steps.
 
*# Column generation algorithms are applicable for general optimization problems and not only cutting stock problems. It is highly recommended that the methodology section and steps involved are rewritten
 
*# Some minor typos/article agreement issues exist “is not partical in real-world”, “provide infeasible integer”..
 
 
* At least one numerical example
 
* At least one numerical example
*# The numerical example contains equations that appear as latex code. Please reformat them correctly.
 
*# Please be consistent in the formatting of mathematical notations and equations.
 
 
* A section to discuss and/or illustrate the applications
 
* A section to discuss and/or illustrate the applications
*# Discuss each application briefly. Example Wikis provided on the website could be used as a reference to do so.
 
 
* A conclusion section  
 
* A conclusion section  
 
* References
 
* References
*# Please consider linking the references by using this as Wiki template, [[Quantum computing for optimization|https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization]]
 
*# Lecture notes may not be a credible reference. Please find the original source.
 
  
 
==[[Heuristic algorithms]]==
 
==[[Heuristic algorithms]]==
  
 
* An introduction of the topic
 
* An introduction of the topic
*# Space between the period at the end of the sentence and the reference should be deleted throughout the Wiki.
 
 
* Theory, methodology, and/or algorithmic discussions
 
* Theory, methodology, and/or algorithmic discussions
*# Algorithm for the scheduling problem needs reformatting. The current version contains latex code, please consider using pseudo code instead of the current version.
 
*# Greedy method to solve minimum spanning tree seems to be missing.
 
*# Please provide references regarding Local Search methods.
 
*# Missing period in “The term Genetic Algorithm…”.
 
 
* At least one numerical example
 
* At least one numerical example
*# For the examples presented for some heuristic algorithms, please add a numerical example rather than discussing a general example and demonstrate the algorithm by actually solving the same.
 
 
* A section to discuss and/or illustrate the applications
 
* A section to discuss and/or illustrate the applications
*# A separate section for applications could be added instead of demonstrating algorithm in the methodology section.
+
* A conclusion section
* A conclusion section  
+
* Reference
*# Conclusions are missing from the Wiki. Please refer to the Wiki examples provided to use as a reference for this section.
 
*# Minor typos and missing articles exist “decrease temperature according to certain cooling scheme”, “as final (‘optimal’) solution”, “such condition”
 
*# Please consider using the American forms of “travelling, neighbourhood”
 
* References
 
*# Some resources are not quite reliable, please consider using original ones: Brilliant Math & Science Wiki, Freecodecamp.Org, HackerEarth..
 
  
 
==[[Branch and cut]]==
 
==[[Branch and cut]]==
  
 
* An introduction of the topic
 
* An introduction of the topic
*# Please use proper technical terminology, for example, linear programs that are integer based are called mixed-integer linear programs.
 
*# Please describe the terms used or their relevance at the very least, like lower bounds and nodes.
 
*# Fix word choice to number: “minimize the amount of nodes”
 
*# No references present in this section.
 
 
* Theory, methodology, and/or algorithmic discussions
 
* Theory, methodology, and/or algorithmic discussions
 
*# Equation in most infeasible branching section is not properly formatted, please fix the same.
 
*# Equation in most infeasible branching section is not properly formatted, please fix the same.
*# Ensure that abbreviations like B&B and LP are not used without defining them first.
 
*# All the steps in the algorithm section are defined as subsection headings which can be identified by the presence of edit option at all steps. The clutter can be removed by simply highlighting the steps in bold rather than defining them as sub-headings.
 
 
*# Step 2 appears abruptly in the algorithm and does not explain much. Please add more information regarding the same.
 
*# Step 2 appears abruptly in the algorithm and does not explain much. Please add more information regarding the same.
*# The algorithm would be much more comprehensible if all steps are discussed in terms of a general MILP optimization problem with generic objective function and constraints that uses symbols rather than numerical values for coefficients.
 
 
*# Step 5 contains latex code terms that are not properly formatted. Please fix the same.
 
*# Step 5 contains latex code terms that are not properly formatted. Please fix the same.
*# Step 6 mentions external reference that seems to be missing.
+
*# Fix typos:  e.g., repeated “for the current”, men Problem can viewed as partially” ..
*# Fix typos:  repeated “for the current”, “For each variable we choose variable “, “Branch and Cut for is a variation”, “Bender’s Decomposition is a great use in Stochastic Programming”, “Salesmen Problem can viewed as partially” ..  
 
 
* At least one numerical example
 
* At least one numerical example
*# Numerical example is poorly formatted. Please format the equations appropriately either by using latex code or the visual editor. The provided Wiki examples could be used as a reference for formatting equations and symbols.
 
*# First, provide the problem that is to be solved. Then move on to the next step by converting it to LP and performing branch and cut.
 
*# The final step that includes the Gomory cut in the LP does not look accurate. Please consider the correct cut and resolve the LP.
 
*# The same non-integer solution is obtained for the final step and a previous step. Please resolve the problem using the correct branch and cut procedure and verify the solution by solving the original MILP problem with an integer solver like CPEX or Gurobi.
 
 
* A section to discuss and/or illustrate the applications
 
* A section to discuss and/or illustrate the applications
*# Please add a few references to the applications presented.
 
 
* A conclusion section  
 
* A conclusion section  
 
* References
 
* References
*# The references listed here are not used in any of the text in the Wiki. Please link them appropriately.
 
*# Please consider linking the references by using this as Wiki template, [[Quantum computing for optimization|https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization]]
 
*# Wiki pages may not be a credible reference. Please find the original source.
 
  
 
== [[Mixed-integer linear fractional programming (MILFP)]] ==
 
== [[Mixed-integer linear fractional programming (MILFP)]] ==

Revision as of 15:13, 14 December 2020

Duality

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Double check indexes in the dual problem. LHS of the dual problem constraint should be aji.
    2. Equations in the “constructing the dual” subsection should be aligned properly.
    3. Please add more details to the KKT Conditions section.
    4. Remove colon in the subsection title
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Lecture notes may not be a credible reference. Please find the original source.

Simplex algorithm

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. The symbol i in the second expression in dictionary functions, ranges from 1 to m.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References 1. Please be consistent with referencing style.

Computational complexity

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Please introduce the Big-oh notation in this section.
  • At least one numerical example
    1. Examples of combinatorial optimization is suggested.
  • A section to discuss and/or illustrate the applications
    1. The applications mentioned need to be discussed further.
  • A conclusion section
  • References.

Network flow problem

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions.
  • At least one numerical example
    1. There is NO need to include code. Simply mention how the problem was coded along with details on the LP solver used.
    2. The subsection title style should be consistent.
  • A section to discuss and/or illustrate the application
  • A conclusion section
  • References

Interior-point method for LP

  • An introduction of the topic
    1. Fix typos “where A ε R”
    2. Please type “minimize” and “subject to” in formal optimization problem form throughout the whole page.
  • Theory, methodology, and/or algorithmic discussions
  • At least one numerical example
    1. The numerical example does not use any Newton’s method iterations that are presented in the above section. Please consider using a complicated example that actually uses Newton’s iterations.
    2. Please type the maximization problem in LaTex form.
  • A section to discuss and/or illustrate the applications
    1. Please double check typos and extra spaces.
  • A conclusion section
  • References

Optimization with absolute values

  • An introduction of the topic
    1. Add few sentences on how absolute values convert optimization problem into a nonlinear optimization problem.
  • Theory, methodology, and/or algorithmic discussions
    1. Please add more details to absolute values in nonlinear optimization. (very important!)
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
    1. Inline equations at the beginning of this section are not formatted properly. Please fix the notation for expected return throughout the section.
  • A conclusion section
  • References

Matrix game (LP for game theory)

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. aij are not defined in this section.
  • At least one numerical example
    1. Interesting example, very well explained.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Quasi-Newton methods

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Please ensure that few spaces are kept between the equations and equation numbers.
    2. Step 6 of DFP algorithm should use the same variable M as in equation 1.14.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References

Markov decision process

  • An introduction of the topic
    1. Please fix typos such as “discreet”.
  • Theory, methodology, and/or algorithmic discussions
    1. If abbreviations are defined like MDP, use the abbreviations throughout the Wiki.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Eight step procedures

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
  • At least one numerical example
    1. Please be consistent in the formatting of mathematical notations and equations.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Lecture notes may not be a credible reference. Please find the original source.

Facility location problem

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
  • At least one numerical example
    1. Mention how the formulated problem is coded and solved. No need to provide GAMS code.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Set covering problem

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Use proper math notations for “greater than equal to”.
  • At least one numerical example
    1. Since Table 3 provides information on aij required to formulate the constraints, Table 2 serves no purpose and should be removed from the Wiki. Table 3 can be directly generated from Table 1.
    2. The numerical example is solved manually without using greedy method nor LP solution method. Please solve this example both by the presented greedy algorithm and the newly added LP-based method and finally compare solutions.
    3. Please leave some space between equation and equation number.
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References

Quadratic assignment problem

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Discuss dynamic programming and cutting plane solution techniques briefly.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
    1. Please format the equation for definition of yij in the hospital layout subsection.
  • A conclusion section
  • References

Newsvendor problem

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. A math programming formulation of the optimization problem with objective function and constraints is expected for the formulation. Please add any variant of the newsvendor problem along with some operational constraints.
    2. A mathematical presentation of the solution technique is expected. Please consider any distribution for R  and present a solution technique for that specific problem.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References

Mixed-integer cuts

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
    1. MILP and their solution techniques involving cuts are extremely versatile. Yet, only two sentences are added to describe their applications. Please discuss their applications, preferably real-world applications, in brief. Example Wikis provided on the website could be used as a reference to do so.
  • A conclusion section
  • References

Column generation algorithms

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References

Heuristic algorithms

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • Reference

Branch and cut

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Equation in most infeasible branching section is not properly formatted, please fix the same.
    2. Step 2 appears abruptly in the algorithm and does not explain much. Please add more information regarding the same.
    3. Step 5 contains latex code terms that are not properly formatted. Please fix the same.
    4. Fix typos:  e.g., repeated “for the current”, men Problem can viewed as partially” ..
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References

Mixed-integer linear fractional programming (MILFP)

  • An introduction of the topic
    1. The abbreviation MINFP is not previously defined. Please fix the same.
  • Theory, methodology, and/or algorithmic discussions
    1. The symbol Q used for objective is often used to denote the set of real numbers. Please simple use a standard Q notation rather than a special form of Q. Same goes for objective function R.
  • At least one numerical example
    1. Please provide comparison between solutions obtained with presented solution technique and MINLP solver for the numerical example for verification of global minimum.
    2. Please check the index notation in Mass Balance Constraints.
    3. Please check the typo “obje” in Maximizing Unit NPV.
    4. Please check other typos as “continous”, “each fractional objective functions, which are shown as below”,”typical algorithm that aim”
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Please consider linking the citations to references in the reference list by using this as Wiki template, rather than using website links. https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Convex generalized disjunctive programming (GDP)

  • An introduction of the topic
    1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
    2. Please refrain from using abbreviations without defining them first.
    3. References missing for solvers.
  • Theory, methodology, and/or algorithmic discussions
    1. Please format yP in the text correctly.
    2. Verify all sentences in the NLP subproblem for a fixed yP subsection, some words seem to be missing.
    3. Mention few more sentences on the hull reformulation and present the reformulated MINLP problem if possible.
    4. Fix typos: “So with said”, “dijunctive”, “solve this both”, ..
  • At least one numerical example
    1. Source of the figures can be cited by mentioning the name of the paper or using the same referencing style like the previous sections rather than link to the actual paper.
  • A section to discuss and/or illustrate the applications
    1. Please relabel the figure by order of appearance.
  • A conclusion section
  • References
    1. Reference # 6 has all uppercase letters. Please use a consistent style for all references.

Fuzzy programming

  • An introduction of the topic”
    1. Please fix the typo: “also know as”
  • Theory, methodology, and/or algorithmic discussions
    1. Very well written.
    2. Discussion on converting piecewise linear membership functions into MILP constraints could be added for further understanding.
    3. Some minor typos exist: “ a cold set and an hot set”, “"more hot"”,
  • At least one numerical example
    1. Significant whitespace present between problem formulations and text. Try to reduce this whitespace.
    2. Please fix minor typos: “real word”, “Each firm has their own”
  • A section to discuss and/or illustrate the applications
    1. Applications of fuzzy programming are quite versatile. Please discuss few of the mentioned applications briefly. The provided example Wikis can be used as a reference to write this section.
  • A conclusion section
    1. Add few more sentences to the conclusion section to better summarize the presented theory, methods and examples.
  • References
    1. Links to the cited content is not the right way to cite. Please refer to the example Wikis to use a better (accurate) referencing style.
    2. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Adaptive robust optimization

  • An introduction of the topic
    1. References at the end of the sentence should be placed after the period.
  • Theory, methodology, and/or algorithmic discussions
    1. Try to better explain the first stage and second stage decisions in terms of here and now and wait and see decisions.
    2. It is claimed that x2(u)  is independent of u. Please verify and fix if necessary.
    3. The text contains “[ref various papers]”. Please add the appropriate references here.
    4. The abbreviation KKT is not previously defined.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
  • References
    1. Overall, very well written.

Stochastic gradient descent

  • An introduction of the topic
    1. Fix this sentence. “Gradient descent picks any random weight …”. The user initializes the weights and not SGD.
  • Theory, methodology, and/or algorithmic discussions
    1. Use j to denote jth data point in step 4 of the SGD algorithm and in Mini-batch gradient descent subsection.
    2. Citations required for the claims in the “learning rate” subsection.
    3. Please fix the repeated typo “a local minima is reached”
  • At least one numerical example
    1. Bias in linear regression is a completely separate topic and is relevant for estimators. Please use correct terminology for the unknown parameters of linear regression.
    2. Fix language used in the dataset subsection of the numerical example.
    3. Amount of whitespace can be reduced by changing orientation of example dataset by converting it into a table containing 3 rows and 6 columns.
    4. Backpropagation is a technique used to update weights of a neural network. For the linear regression example, simply gradients w.r.t unknown parameters are computed. Please update the subsection title accordingly.
    5. Ensure that the readers clearly understand that first the algorithm iterates through each data point and then repeats itself all over again with the updated parameters. This can be done by demonstrating iteration 2 using the next datapoint.
    6. Add reference for the overfitting comment.
  • A section to discuss and/or illustrate the applications
    1. Mention how SGD is relevant for logistic regression.
    2. The application section starts with discussing relevance of SGD for deep learning, but no discussion on deep learning/ neural networks is present. Subsection on deep learning and the variants of SGD used for deep learning can be mentioned.
    3. The abbreviation is SGD, please fix it throughout.
  • A conclusion section
    1. No mention of global minima is present in the entire Wiki. Either add citation for the global minimum statement or remove this claim.
    2. Fix abbreviations for SGD here as well.
  • References
    1. Fix duplicate reference numbers.
    2. Some references are not linked to the text in Wiki, please update accordingly.
    3. Reference # 2 has all uppercase letters. Please use a consistent style for all references.

RMSProp

  • An introduction of the topic
    1. Few sentences in this section are incoherent. Please use grammatically correct sentences.
  • Theory, methodology, and/or algorithmic discussions
    1. The equation presented in the Artificial neural network subsection is valid for the perceptron and not neural net. Please fix either the title or the equation.
    2. In the Rprop subsection, the momentum parameter is discussed but not used in any of the corresponding equations.
    3. Fix typos like PMSprop,  Aritifical, in the RMSprop subsection.
    4. The default value of parameters in the RMSprop subsection is mentioned but their relevance or their calculation  is not explained.
    5. Please check grammar in this section.
    6. Please avoid using contractions (e.g. doesn’t).
    7. The use of “Obviously” is advised against
  • At least one numerical example
    1. Please demonstrate the working of RMSprop by actually solving any unconstrained optimization problem. Providing links to other resources for numerical examples renders the purpose of Wiki useless.
  • A section to discuss and/or illustrate the applications
    1. The applications section does not contain any discussion on applications. Please mention a few applications of the widely used RMSprop and discuss them briefly.
    2. Misspelling for applications.
    3. Please check grammar in this section.
  • A conclusion section
    1. Formulation of ANN is incorrect terminology. ANNs are trained by RMSprop.
    2. It is claimed that RMSprop achieves global optimization without any reference. Please provide a reference for the same or update the said claim.
  • References
    1. For reference #1 please find the original source of the images and cite that source, rather than citing an image hosting service.
    2. Please refer to the example Wikis provided to use proper citation style.
    3. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization

Adam

  • An introduction of the topic
  • Theory, methodology, and/or algorithmic discussions
    1. Key challenges mentioned in the mini-batch SGD are more relevant to the batch SGD. Consider moving these to the corresponding section.
  • At least one numerical example
  • A section to discuss and/or illustrate the applications
  • A conclusion section
    1. Some minor formatting issues between symbols and text should be fixed.
  • References
    1. Please consider linking the references by using this as Wiki template, https://optimization.cbe.cornell.edu/index.php?title=Quantum_computing_for_optimization
    2. Overall, very well written.