|
|
Line 1: |
Line 1: |
| Author: Daphne Duvivier, Daniela Gil, Jacqueline Jackson, Sinclaire Mills, Vanessa Nobre (SYSEN 5800, Fall 2021)
| | ===Example of Convexification in MINLP === |
| | |
| | |
| == Introduction ==
| |
| | |
| Exponential transformations are simple algebraic transformations of monomial functions through a variable substitution with an exponential variable.
| |
| | |
| Information regarding the algebraic properties of exponential transformation
| |
| | |
| In computational optimization exponential transformations are used for convexification of geometric programming constraints (posynominal) nonconvex optimization problems. This transformation creates a convex function without changing the decision space of the problem. <ref> Li, D., Biswal, M.P. Exponential Transformation in Convexifying a Noninferior Frontier and Exponential Generating Method. Journal of Optimization Theory and Applications 99, 183–199 (1998). https://doi.org/10.1023/A:1021708412776 </ref> Through the use of exponential transformation the time to solve an Non-linear program (NLP) or a Mixed integer non-linear program (MINLP) is reduced by allowing the use of a global solve approach.
| |
| | |
| | |
| == Theory & Methodology ==
| |
| | |
| Exponential transformation can be applied to geometric programs
| |
| | |
| A geometric program is a mathematical optimization problem
| |
| | |
| Geometric Programs take the form of:
| |
| | |
| <math> min f_0(x) </math>
| |
| <math> s.t. f_i(x) \leq 1 i = 1,....,m </math>
| |
| <math> s.t. g_i(x) = 1 i = 1,....,p </math>
| |
| | |
| convexification of a non-inferior frontier - based on having a differentiable objective function https://link.springer.com/content/pdf/10.1023/A:1021708412776.pdf
| |
| | |
| this would apply to any polynomial.
| |
| A posynomial is defined as define polynomials:
| |
| | |
| Exponential transformation begins with a posynominal (Positive and Polynomial) noncovex function of the form <ref> Boyd, S., Kim, SJ., Vandenberghe, L. et al. A tutorial on geometric programming. Optim Eng 8, 67 (2007). https://doi.org/10.1007/s11081-007-9001-7 </ref> :
| |
| | |
| <math> f(x) = \sum_{k=1}^N c_k{x_1}^{a_{1k}}{x_2}^{a_{2k}}....{x_n}^{a_{nk}} </math>
| |
| | |
| where <math> c_k \geq 0 </math> and <math> x_n \geq0 </math>
| |
| | |
| A transformation of <math> x_n = e^u_i </math> is applied <ref> Grossmann, I.E. Review of Nonlinear Mixed-Integer and Disjunctive Programming Techniques. Optimization and Engineering 3, 227–252 (2002). https://doi.org/10.1023/A:1021039126272 </ref>
| |
| | |
| The transformed function is presented as:
| |
| | |
| <math> f(u) = \sum_{k=1}^N c_k{{e}^{{u_1}{a_{1k}}}{e}^{{u_2}{a_{2k}}}....{e}^{{u_n}{a_{nk}}}} </math>
| |
| | |
| | |
| ===Exponential transformation in Computational Optimization===
| |
| Exponential transformation can be used for convexification of any Geometric MINLP that meet the criteria of equation 1. This is done by turning the problem into a nonlinear convex optimization problem through exponential transformation. Using the exponential substitution detailed above all continuous variables in the function are transformed while binary variables are not transformed.
| |
| | |
| Additionally as presented in Theorem 1 and accompanying proof in "Global optimization of signomial geometric programming using linear relaxation" by P. Shen, K. Zhang, given that a function is being minimized it shows that after transformation all points on the transformed function are feasible in the original function and all objective values in the transformed function are the same or less than the original function. <ref> Boyd, S., Kim, SJ., Vandenberghe, L. et al. A tutorial on geometric programming. Optim Eng 8, 67 (2007). https://doi.org/10.1007/s11081-007-9001-7 </ref> Also presented by Li and Biswal the bounds of the problem are not altered through exponential transformation. <ref> Li, D., Biswal, M.P. Exponential Transformation in Convexifying a Noninferior Frontier and Exponential Generating Method. Journal of Optimization Theory and Applications 99, 183–199 (1998). https://doi.org/10.1023/A:1021708412776 </ref>
| |
| | |
| | |
| ===Simple Numerical Example ===
| |
| <math> {\frac{x_1^3}{x_2^4}} + {x_1^2} + {\sqrt[3]{x_2^2}} \leq 4</math>
| |
| | |
| Reformulating to exponents
| |
| | |
| <math> {x_1^3}*{x_2^{-4}} + {x_1^2} + {x_2^{\frac{2}{3}}} \leq 4 </math>
| |
| | |
| Substituting <math> x_1 = e^{u_1}, x_2 = e^{u_2} </math>
| |
| | |
| <math>{{e^{u_1}}^3}*{{e^{u_2}}^{-4}} + {{e^{u_1}}^2} + {{e^{u_2}}^{\frac{2}{3}}} \leq 4 </math>
| |
| | |
| Simplifying by exponent properties
| |
| | |
| <math> {e^{3{u_1} - 4{u_2}}} + {e^{{2}{u_1}}} + {{e^{{\frac{2}{3}}{u_2}}}} \leq 4 </math>
| |
| | |
| ===Example of Convexification application in MINLP === | |
|
| |
|
| The following MINLP problem can take a Covexification approach using exponential transformation: | | The following MINLP problem can take a Covexification approach using exponential transformation: |
Line 82: |
Line 19: |
| Using the exponential transformation to continuous variables <math>x_1, x_2, x_3 </math> by substituting <math> x_1 = e^{u_1} and x_2 = e^{u_2} </math> described the problem becomes the following: | | Using the exponential transformation to continuous variables <math>x_1, x_2, x_3 </math> by substituting <math> x_1 = e^{u_1} and x_2 = e^{u_2} </math> described the problem becomes the following: |
|
| |
|
| min <math> Z = 5{e^{2{u_1}}}{e^{8{u_2}}} + 2{e^{u_1}}{e^{2u_2}} + \frac{e^{{u_2}{3}}} + 5{y_1} + 2 {y_2^2} </math>
| | <math> min Z = 5{e^{2{u_1}}}{e^{8{u_2}}} + 2{e^{u_1}}{e^{2u_2}} + \frac{e^{{u_2}{3}}} + 5{y_1} + 2 {y_2^2} </math> |
|
| |
|
| s.t | | <math> s.t </math> |
|
| |
|
| <math> {e^{u_1}} \leq 7{e^{0.2{u_2}}} </math> | | <math> {e^{u_1}} \leq 7{e^{0.2{u_2}}} </math> |
Line 147: |
Line 84: |
| </math> | | </math> |
|
| |
|
| Therefore H(x) is positive-definite and strictly convex. | | Therefore H(x) is positive-definite and strictly convex. |
| | |
| ==Applications==
| |
| | |
| Currently various applications of exponential transformation can be seen in published journal articles and industry practices, due to the closeness with logarithmic transformation usually a combination of the approaches are used in practical solutions.
| |
| | |
| Global optimization of heat exchanger network synthesis problems with and without the isothermal mixing assumption:
| |
| *As seen in eq(34) and (35) of the work by Björk and Westerlund they employ an exponential transformation to convexify their optimization problem to employ a global optimization approach. <ref>{{cite journal |title=Global optimization of heat exchanger network synthesis problems with and without the isothermal mixing assumption |journal=Computers & Chemical Engineering |year=2002 |last=Björk |first=Kaj-Mikael |last2=Westerlund |first2=Tapio |volume=26 |issue=11 |pages=1581-1593 |issn=ISSN 0098-1354 |doi=10.1016/S0098-1354(02)00129-1 |url=https://www.sciencedirect.com/science/article/pii/S0098135402001291?casa_token=G7OVOrBKagoAAAAA:1hUCHkGascVlawR3OfBpolNXlFqPSBUhWL6MkVAhn-ofKVfF-CbhVK6ZfSCKQ7i6mRQ9MTaqf9Q |accessdate=2021-11-27 }}</ref>
| |
| | |
| | |
| Electrical Engineering Application: http://home.eng.iastate.edu/~cnchu/pubs/j08.pdf
| |
| | |
| | |
| Quadratic Geometric Programming
| |
| Ecconomics: https://link.springer.com/content/pdf/10.1007/BF02591746.pdf
| |
| | |
| ==Conclusion==
| |
| Exponential transformation is a useful method to convexify Geometric MINLP and obtain a global solution to the problem. Exponential transformation does not alter the bounds of the problem and allows for a convex objective function and constraints given that the conditions described under the Theory and methodology section are satisfied. (Add jump metric) Geometric Programming transformation can be further explored through logarithmic transformation to address convexification.
| |
| | |
| ==References==
| |
| <references />
| |
| | |
| {{reflist}}
| |
Example of Convexification in MINLP
The following MINLP problem can take a Covexification approach using exponential transformation:
min
s.t.
Using the exponential transformation to continuous variables by substituting described the problem becomes the following:
With additional logarithmic simplification through properties of natural logarithm:
min
s.t
Where is unbounded due to logarithmic of 0 being indefinite.
The transformed objective function can be show to be convex through the positive-definite test of the Hessian, for the example above the Hessian is as follows [1]:
In order to prove the convexity of the transformed functions the positive definite test of Hessian is used as defined in "Optimization of Chemical Processes" [2] can be used. This tests the Hessian defined as:
to test that
where
for all
for functions the Hessian is defined as:
In the example above the hessian is defined as:
Therefore H(x) is positive-definite and strictly convex.
- ↑ Chiang, Mung. (2005). Geometric Programming for Communication Systems. 10.1561/9781933019574; https://www.princeton.edu/~chiangm/gp.pdf
- ↑ T.F. Edgar, D.M. Himmelblau, L.S. Lasdon, Optimization of Chemical Processes. McGraw-Hill, 2001.