# Difference between revisions of "Mixed-integer linear fractional programming (MILFP)"

Author: Xiang Zhao (SysEn 6800 Fall 2020)

Steward: Allen Yang, Fengqi You

## Introduction

The mixed-integer linear fractional programming (MILFP) is a kind of mixed-integer nonlinear programming (MINLP) that is widely applied in chemical engineering,[1] environmental engineering,[2] and their hybrid field ranging from cyclic-scheduling problems to the life cycle optimization (LCO).[3] Specifically, the objective function of the MINFP is shown as a ratio of two linear functions formed by various continuous variables and discrete variables. However, the pseudo-convexity and the combinatorial nature of the fractional objective function can cause computational challenges to the general-purpose global optimizers, such as BARON, to solve this MILFP problem.[4] In this regard, we introduce the basic knowledge and solution steps of three algorithms, namely the Parametric Algorithm, Reformulation-Linearization method, and Branch-and-Bound with Charnes-Cooper Transformation Method, to efficiently and effectively tackle this computational challenge.

## Standard Form and Properties

Consider such standard form of the MILFP:

{\displaystyle {\begin{aligned}\max T(x,y)={c_{0}+\sum _{i}c_{1,i}m_{i}+\sum _{j}c_{2,j}y_{j} \over d_{0}+\sum _{i}d_{1,i}m_{i}+\sum _{j}d_{2,j}y_{j}}\\s.t.\quad \ a_{0,k}+\sum _{i}a_{1,i}m_{i}+\sum _{j}a_{2,j}y_{j}=0,\quad \forall k\in K\\m_{i}\geq 0,\quad \forall i\in I\\y_{j}\in {0,1},\quad \forall j\in J\end{aligned}}}

The properties of the objective function ${\displaystyle T(x,y)}$ are shown as follows:[5]

1. ${\displaystyle T(x,y)}$ is (strictly) pseudoconcave and pseudoconvex over its domain.
2. The local optimality of ${\displaystyle T(x,y)}$ is the same as its global optimality.

Notably, several nonlinear solvers that can deal with the pseudoconvexity, such as the spatial branch-and-bound (SBB),[6] are capable of solving the MILFP. However, the memory usage of these solvers is enormous when solving a large-scale problem that is applied in industrial scheduling or supply chain optimization project. Hence, we introduce the parametric algorithm, and reformulation-linearization method, which can reformulate the MILFP into the mixed-integer linear programming (MILP) problem, to reduce the memory usage and enhance solution efficiency.

## Parametric Algorithm

One way to successively reformulate and solve the MILFP is to apply the parametric algorithm, which can find the global optimality within finite iterations. The linearly parametric form of the reformulated objective function has the advantage of directly finding the global optimum, while the size of the sub-problem remains the same. The reformulation approach is shown as follows:

The original form of the objective function is: ${\displaystyle T(x,y)={c_{0}+\sum _{i}c_{1,i}m_{i}+\sum _{j}c_{2,j}y_{j} \over d_{0}+\sum _{i}d_{1,i}m_{i}+\sum _{j}d_{2,j}y_{j}}}$

We use a parametric parameter ${\displaystyle q}$ to reformulate the objective function ${\displaystyle T(x,y)}$ into ${\displaystyle M(x,y,q)}$:

${\displaystyle \max T(x,y)={A(x,y) \over B(x,y)}}$

is reformulated into

${\displaystyle \max M(x,y,q)=A(x,y)-q*B(x,y)}$

${\displaystyle A(x,y)={c_{0}+\sum _{i}c_{1,i}m_{i}+\sum _{j}c_{2,j}y_{j}}}$

${\displaystyle B(x,y)={d_{0}+\sum _{i}d_{1,i}m_{i}+\sum _{j}d_{2,j}y_{j}}}$

Notably, the optimal solution of the parametric objective function ${\displaystyle M(x,y,q)}$ has only one zero-point, which is the same as its global optimal solution. Hence, we need to find the zero-point iteratively following the approaches below:[7]

1. Initialize the parametric parameter ${\displaystyle q=0}$. Set the tolerance ${\displaystyle tol=10^{-6}}$
2. Solve the sub-problem via using CPLEX, whose objective function is ${\displaystyle M(x,y,q)}$ with the same original constraints. The optimal solution is ${\displaystyle x^{*},y^{*}}$.
3. Calculate the value of parametric objective function ${\displaystyle M(x^{*},y^{*},q)=A(x^{*},y^{*})-q*B(x^{*},y^{*})}$, if the value is within the tolerance ${\displaystyle tol}$, then the optimality ${\displaystyle (x^{*},y^{*})}$ is found.
4. Update the parametric parameter ${\displaystyle q={A(x^{*},y^{*}) \over B(x^{*},y^{*})}}$ and redo step 1.

## Reformulation-Linearization Method

The reformulation-linearization method, which incorporates the Glover’s linearization[8] into the Charnes-Cooper transformation,[9] introduce auxiliary variables to reformulate the MILFP into equivalent MINLP. The resulting MINLP is subsequently transformed into MILP, which can be efficiently solved by typical MILP solvers like CPLEX, via using Glover’s linearization.The reformulation approach is shown as follows:

The original form of the optimization model is:

{\displaystyle {\begin{aligned}\max T(x,y)={c_{0}+\sum _{i}c_{1,i}m_{i}+\sum _{j}c_{2,j}y_{j} \over d_{0}+\sum _{i}d_{1,i}m_{i}+\sum _{j}d_{2,j}y_{j}}\\s.t.\quad \ a_{0,k}+\sum _{i}a_{1,i}m_{i}+\sum _{j}a_{2,j}y_{j}=0,\quad \forall k\in K\\m_{i}\geq 0,\quad \forall i\in I\\y_{j}\in {0,1},\quad \forall j\in J\end{aligned}}}

Firstly, we convert the fractional objective function into a bilinear constraint, as well as a substutional term ${\displaystyle g_{i}}$:

${\displaystyle u={1 \over d_{0}+\sum _{i}d_{1,i}m_{i}+\sum _{j}d_{2,j}y_{j}}}$

${\displaystyle g_{i}={m_{i}*u}}$

${\displaystyle h_{j}={y_{j}*u}}$

To get the MILP equivalent model, we use the Glover's Linearization to transform the bilinear constraint (${\displaystyle h_{j}={y_{j}*u}}$):

${\displaystyle h_{j}={y_{j}*u}}$

is equivalent to

${\displaystyle h_{j}\leq u,\quad \forall j\in J}$

${\displaystyle h_{j}\leq M*y_{j},\quad \forall j\in J}$

${\displaystyle h_{j}\geq u-M*y_{j},\quad \forall j\in J}$

${\displaystyle h_{j}\geq 0,\quad \forall j\in J}$

${\displaystyle u\geq 0,\quad \forall j\in J}$

${\displaystyle g_{i}\geq 0,\quad \forall i\in I}$

${\displaystyle h_{j}\geq 0,\quad \forall j\in J}$

${\displaystyle y_{j}\in {0,1},\quad \forall j\in J}$

In this regard, we reformulate the original MILFP model into MILP model, which can be effectively solved by typical branch-and-cut solver like CPLEX. To summarize, the reformulated MILP model is shown below:

{\displaystyle {\begin{aligned}\max W(u,g,h)={c_{0}*u+\sum _{i}c_{1,i}g_{i}+\sum _{j}c_{2,j}h_{j}}\\s.t.\quad \ a_{0,k}*u+\sum _{i}a_{1,i}g_{i}+\sum _{j}a_{2,j}h_{j}=0,\quad \forall k\in K\\d_{0}*u+\sum _{i}d_{1,i}g_{i}+\sum _{j}d_{2,j}h_{j}=1\\h_{j}\leq u,\quad \forall j\in J\\h_{j}\leq M*y_{j},\quad \forall j\in J\\h_{j}\geq u-M*y_{j},\quad \forall j\in J\\h_{j}\geq 0,\quad \forall j\in J\\u\geq 0,\quad \forall j\in J\\g_{i}\geq 0,\quad \forall i\in I\\h_{j}\geq 0,\quad \forall j\in J\\y_{j}\in {0,1},\quad \forall j\in J\end{aligned}}}

## Branch-and-Bound with Charnes-Cooper Transformation Method

The integration of the Charnes-Cooper transformation method with the Branch-and-Bound (B&B) algorithm can reformulate the relaxation form of the fractional objective problem in each node into an LP subproblem, which can reach its global optimality via using MILP solvers like CPLEX. Since solution steps are similar to those of B&B and the reformulation step is shown in Reformulation-Linearization Method, we encourage readers to search for B&B algorithm and paper of Gao et al.[10]

## Application and Modeling for Numerical Examples

### Applications of MILFP

Two typical applications are introduced in this section, namely cyclic scheduling and life-cycle optimization.[11] One typical cyclic scheduling problem was illustrated in Yue et al.[12], the fractional objective was optimized to reflect both the absolute profit and scheduling aspect, which were shown in the numerator and denominator, respectively. The combination of Reformulation-Linearization method and CPLEX were regarded as solution algorithm and the optimization framework was applied in a case study corresponding to a multiproduct batch plant that used 14 processing stages for producing three acrylic fiber formulations with a time horizon of 100 h.

In the life-cycle optimization problem of a certain processing system, the unreasonably maximum or minimum treatment amount from optimizing linear objective functions can be avoided via optimizing the fractional objective, and thus the balanced processing amount can be obtained to address the sustainable design and synthesis of this processing system.[13] Notably, the functional unit is shown in the denominator, while the total economic and environmental performances are denoted as numerators in fractional objective functions. Specifically as illustrated in Gong et al.,[14] the sustainable design and synthesis of the shale gas processing system was obtained via optimizing the unit net present value (NPV), unit global warming potential (GWP), and unit freshwater consumption simultaneously. The optimization framework was applied in the Marcella Shale gas site.

In the next two numerical examples, we present a “simple form” of MILFP that can be used for selecting optimal processing pathways via maximizing unit NPV or minimizing unit GWP, respectively.

### Numerical Examples of MILFP

#### Introduction of Numerical Examples

Figure 1. Superstructure of the chemical processing system

Let’s consider a simple chemical plant, whose superstructure is shown on the right side. The superstructure denotes all technology options, and only one of them in each level can be chosen simultaneously. To find the optimal processing pathway on the basis of economic and environmental aspects, we consider maximizing the net present value (NPV) or minimizing unit greenhouse gas (GHG) emissions, respectively. Notably, the unit NPV equals the ratio of the NPV with the total mass flow rate of product I within the project lifespan of ten years. The discount rate is 10%.

#### Input Parameters of Numerical Examples

Conversion Rate of each Chemical
Processing Level Conversion Rate Conversion Rate Conversion Rate
Level 1 D to E: 0.8 D to F: 0.9
Level 2 E to G: 0.7 E to H: 0.8 F to H: 0.4
Level 3 G to I: 0.5 H to I: 0.6
Fixed Capital Cost for each Technology Alternative ($) A1 A2 A3 B1 B2 B3 C1 C2 C3 6,000,000 7,000,000 7,500,000 5,000,000 6,000,000 7,500,000 11,000,000 10,000,000 10,500,000 Variable Capital Cost for each Technology Alternative ($/(ton/yr))
A1 A2 A3 B1 B2 B3 C1 C2 C3
50 40 35 60 55 45 30 35 33
Operating Cost for each Technology Alternative ($/(ton/yr)) A1 A2 A3 B1 B2 B3 C1 C2 C3 25 30 20 30 28 50 27 25 15 Feedstock Supply and Demand of Product (ton/yr)/Feedstock and Product Price ($/(ton/yr))
Item Supply/Demand Feedstock/Product Price
D 2,000,000 100
I 200,000 2000
GHG Emissions from each Technology Option (ton CO2-eq/ton inlet chemicals)
A1 A2 A3 B1 B2 B3 C1 C2 C3
1.2 0.9 0.7 1.4 1.6 1.3 2.1 2.4 2.7

#### Nomenclatures for the Mathematical Model of the Numerical Examples

Nomenclature
Nomenclature Meaning
${\displaystyle I}$ Set of production stages indexed by ${\displaystyle i}$.
${\displaystyle J}$ Set of process alternatives ${\displaystyle j}$.
${\displaystyle D}$ Demand of product I.
${\displaystyle CAV_{i,j}}$ Unit variable capital cost in the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle CV_{i,j}}$ Conversion rate from input flow to output flow in the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle FIXI_{i,j}}$ Fixed capital cost in the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle GHG_{i,j}}$ Unit GHG emissions from the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle OPERI_{i,j}}$ Unit operating cost in the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle PRI}$ Price of product I.
${\displaystyle PRID}$ Price of chemical D.
${\displaystyle S}$ Supply of chemical D.
${\displaystyle y_{i,j}}$ 0-1 variable. Equals to one if the process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$ is selected.
${\displaystyle ca_{i,j}}$ Capacity of process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle fec}$ Total feedstock cost.
${\displaystyle fix}$ Total fixed capital cost.
${\displaystyle ghgt}$ Total GHG emissions.
${\displaystyle mi_{i,j}}$ Mass flow rate of the feedstock flow to process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle mo_{i,j}}$ Mass flow rate of the output flow to process alternative ${\displaystyle j}$ at the production stage ${\displaystyle i}$.
${\displaystyle oper}$ Total operating cost.
${\displaystyle objc}$ Unit net present value (NPV).
${\displaystyle obje}$ Unit GHG emissions (within one operating year).
${\displaystyle npv}$ Net present value.
${\displaystyle sale}$ Total sales.
${\displaystyle vai}$ Total variable capital cost.

##### Mass Balance Constraints
 ${\displaystyle mi_{i,j}\leq ca_{i,j},\quad \forall i\in I,\forall j\in J}$


This aforementioned constraint denotes that the mass flow rate of the inlet flow should not exceed the treatment capacity.

 ${\displaystyle ca_{i,j}\leq M*y_{i,j},\quad \forall i\in I,\forall j\in J}$


This aforementioned constraint represents that the treatment capacity would be zero if the corresponding technology option is not selected.

 ${\displaystyle mo_{i,j}=mi_{i,j}*CV_{i,j},\quad \forall i\in I,\forall j\in J}$


This aforementioned constraint illustrates the conversion of the inlet flow and the outlet flow.

 ${\displaystyle \sum _{j}mo_{i-1,j}=\sum _{j}mi_{i,j},\quad \forall i\geq 2,\forall j\in J}$


This aforementioned constraint denotes that the summation of mass flow rates of the outlet flows from the previous processing level equals to those of the inlet flows in the next processing level.

 ${\displaystyle \sum _{j}mo_{3,j}\geq D,\quad \forall i\in I,\forall j\in J}$


This aforementioned constraint represents that the summation of mass flow rates of the technology options in the third processing level should be larger than the demand of the product I.

 ${\displaystyle \sum _{j}mi_{1,j}\leq S,\quad \forall i\in I,\forall j\in J}$


This aforementioned constraint represents that the summation of mass flow rates of the technology options in the first processing level should be less than the supply of the chemical D.

##### Superstructure Configuration Constraints

Notably, the superstructure configuration constraints illustrate the logic relationship between each technology option within the superstructure. If the binary variable ${\displaystyle y_{i,j}}$ equals to 1, than the technology option ${\displaystyle j}$ in the process level ${\displaystyle i}$ is selected.

 ${\displaystyle y_{1,1}+y_{1,2}+y_{1,3}=1}$

 ${\displaystyle y_{1,1}+y_{1,2}=y_{2,1}+y_{2,2}}$

 ${\displaystyle y_{1,3}=y_{2,3}}$

 ${\displaystyle y_{2,1}=y_{3,1}}$

 ${\displaystyle y_{2,2}+y_{2,3}=y_{3,2}+y_{3,3}}$

##### Economic Evaluation Constraints

We consider the fixed capital cost (${\displaystyle fix}$), variable capital cost (${\displaystyle vai}$), operating cost (${\displaystyle oper}$), and feedstock cost (${\displaystyle fec}$) as the expenses for the chemical processing system.

 ${\displaystyle fix=\sum _{i}{\sum _{j}FIXI_{i,j}*y_{i,j}}}$

 ${\displaystyle vai=\sum _{i}{\sum _{j}CAV_{i,j}*ca_{i,j}}}$

 ${\displaystyle oper=\sum _{i}{\sum _{j}OPERI_{i,j}*mo_{i,j}}}$

 ${\displaystyle fec=PRID*\sum _{j}mi_{1,j}}$

 ${\displaystyle sale=PRI*\sum _{j}mo_{3,j}}$


The net present value is calculated in the constraint below (${\displaystyle fix}$), where we account for the total discounted cash flow (${\displaystyle {DR*(1+DR)^{SP} \over (1+DR)^{SP}-1}*(sale-vai-oper-fec)}$) and ${\displaystyle SP}$ represents for the lifespan of the this project.

 ${\displaystyle npv={DR*(1+DR)^{SP} \over (1+DR)^{SP}-1}*(sale-vai-oper-fec)-fix}$

##### Environmental Evaluation Constraint

The total GHG emissions from the chemical processing system is calculated in the constraint below.

 ${\displaystyle ghgt=\sum _{i}{\sum _{j}GHG_{i,j}*mi_{i,j}}}$

##### Objective Functions

Two numerical examples are presented as optimizing each fractional objective function, which are shown as below. Since all constraints denote the relationship between various continuous and discrete variables, two aforementioned numerical problems can be regarded as MILFPs. We consider maximizing unit NPV (${\displaystyle \max \quad \ obje}$) or minimizing unit global warming potential global warming potential (GWP) (${\displaystyle \min \quad \ ghgt}$) in two numerical examples, respectively.

 ${\displaystyle obje={npv \over \sum _{j}mo_{3,j}}}$

 ${\displaystyle objc={ghgt \over \sum _{j}mo_{3,j}}}$


## Solution for Numerical Examples

### Maximizing Unit NPV

We consider the first objective function (${\displaystyle obje}$) and all constraints in the mathematical model, where we can reformulate the objective function into a parametric form (${\displaystyle obj_{1}}$) using parametric parameter ${\displaystyle q_{1}}$:

 ${\displaystyle \max \quad \ obj_{1}={npv-q_{1}*\sum _{j}mo_{3,j}}}$

 ${\displaystyle s.t.\quad \ Mass\ \ Balance\ \ Constraints,Superstructure\ \ Configuration\ \ Constraints,Economic\ \ Evaluation\ \ Constraints}$


This reformulated model can be solved by the CPLEX iteratively, and the solution is shown as follows:

Process to be built
Level 1 Level 2 Level 3
A1 - -
- B2 -
- - C3
Performance
Production Amount (ton/yr) Unit NPV ($/ton) Unit GHG Emissions (ton CO2-eq/ton products) 768,000 187.75 10.18 ### Minimizing Unit GHG Emissions We consider the first objective function (${\displaystyle objc}$) and all constraints in the mathematical model, where we can reformulate the objective function into a parametric form (${\displaystyle obj_{2}}$) using parametric parameter ${\displaystyle q_{2}}$:  ${\displaystyle \min \quad \ obj_{2}={ghgt-q_{2}*\sum _{j}mo_{3,j}}}$   ${\displaystyle s.t.\quad \ Mass\ \ Balance\ \ Constraints,Superstructure\ \ Configuration\ \ Constraints,Environmental\ \ Evaluation\ \ Constraints}$  This reformulated model can be solved by the CPLEX iteratively, and the solution is shown as follows: Process to be built Level 1 Level 2 Level 3 - - - A2 B2 C2 - - - Performance Production Amount (ton/yr) Unit NPV ($/ton) Unit GHG Emissions (ton CO2-eq/ton products)
768,000 186.23 9.68

## Conclusion

The mixed-integer linear fractional programming (MILFP) is a kind of mixed-integer nonlinear programming (MINLP) that is implemented into evaluating the average performance of a certain project. The Parametric Algorithm, Reformulation-Linearization Method, and Branch-and-Bound with Charnes-Cooper Transformation Method are three typical algorithm that aim to tackle the computational challenge caused by the fractional objective. The optimization framework can be applied to the chemical engineering, environmental engineering, and their combined area such as life-cycle optimization.

## References

1. Liu, S., Gerontas, S., Gruber, D., Turner, R., Titchener‐Hooker, N. J., & Papageorgiou, L. G. (2017). Optimization‐based framework for resin selection strategies in biopharmaceutical purification process development. Biotechnology Progress, 33(4), 1116-1126.
2. Zhu, H. (2014). Inexact fractional optimization for multicriteria resources and environmental management under uncertainty (Doctoral dissertation, Faculty of Graduate Studies and Research, University of Regina).
3. Gao, J., & You, F. (2017). Economic and environmental life cycle optimization of noncooperative supply chains and product systems: modeling framework, mixed-integer bilevel fractional programming algorithm, and shale gas application. ACS Sustainable Chemistry & Engineering, 5(4), 3362-3381.
4. Zhong, Z., & You, F. (2014). Globally convergent exact and inexact parametric algorithms for solving large-scale mixed-integer fractional programs and applications in process systems engineering. Computers & Chemical Engineering, 61, 90-101.
5. You, F., Castro, P. M., & Grossmann, I. E. (2009). Dinkelbach's algorithm as an efficient method to solve a class of MINLP models for large-scale cyclic scheduling problems. Computers & Chemical Engineering, 33(11), 1879-1889.
6. Quesada, I., & Grossmann, I. E. (1995). A global optimization algorithm for linear fractional and bilinear programs. Journal of Global Optimization, 6(1), 39-76.
7. Zhong, Z., & You, F. (2014, June). Parametric algorithms for global optimization of mixed-integer fractional programming problems in process engineering. In 2014 American Control Conference (pp. 3609-3614). IEEE.
8. https://glossary.informs.org/ver2/mpgwiki/index.php/Glovers_linearization
9. Charnes, A., & Cooper, W. W. (1973). An explicit general solution in linear fractional programming. Naval Research Logistics Quarterly, 20(3), 449-467.
10. Gao, J., & You, F. (2015). Optimal design and operations of supply chain networks for water management in shale gas production: MILFP model and algorithms for the water‐energy nexus. AIChE Journal, 61(4), 1184-1208.
11. Gong, J., & You, F. (2017). Consequential life cycle optimization: general conceptual framework and application to algal renewable diesel production. ACS Sustainable Chemistry & Engineering, 5(7), 5887-5911.
12. Yue, D., & You, F. (2013). Sustainable scheduling of batch processes under economic and environmental criteria with MINLP models and algorithms. Computers & Chemical Engineering, 54, 44-59.
13. Gao, J., & You, F. (2018). Integrated hybrid life cycle assessment and optimization of shale gas. ACS Sustainable Chemistry & Engineering, 6(2), 1803-1824.
14. Gong, J., & You, F. (2018). A new superstructure optimization paradigm for process synthesis with product distribution optimization: Application to an integrated shale gas processing and chemical manufacturing process. AIChE Journal, 64(1), 123-143.