optimization problem for joint entropy



The problem I would like to solve is as follows:

suppose we have two variables X and Y, and X is less or equal to Y. If X, Y can
both take three values, say 1,2,3 at the moment (just for simplicity). And we
know the constraints for X is that the entropy of X is H(X)=a (we can specify a
exact value) also H(Y)=b. Now I would like to find out the maximum
value of H(X,Y).

So if H(X)=log2(3) and H(Y)=log2(3), and the initial search point I provide to
Matlab is (1/3;0;1/3;0;0;1/3) in the order of
P(X=0,Y=0);P(X=0,Y=1);P(X=1,Y=1);P(X=0,Y=2);P(X=1,Y=2);P(X=2,Y=2)
I would like fmincon to give me the result exactly the same as this one. But
matlab just failed to do this.

My problem is multivariable nonlinear constrained problem, would you also please give me some information about any toolbox or algorithm which is useful. That would be great help.

Thanks a lot.
.



Relevant Pages

  • Re: fmincon
    ... To my surprise fmincon does not work in all my codes (that ... run without any problem on other versions of Matlab). ... FMINCON is part of Optimization Toolbox. ... included in the list displayed by the VER function. ...
    (comp.soft-sys.matlab)
  • Re: Partial curve fitting
    ... I wonder if there is a way to fit a specially formed curve to only a part ... (You need an algorithm that is able to detect the most likely ... neither Curve Fitting Toolbox nor Statistics Toolbox have any ... If you google change point + MATLAB + Bayesian you can find a lot of useful ...
    (comp.soft-sys.matlab)
  • Re: Optimization
    ... easy-to-use, and Matlab compatible interpreter. ... > function provided by MATLAB in the medium-scale mode (I cannot use ... > fmincon() uses an algorithm based on Sequential Quadratic Programming ...
    (sci.math.num-analysis)
  • Links to MATLAB Free Toolboxes
    ... Links to MATLAB Free Toolboxes ... Kernel Density Estimation Toolbox for MATLAB ... The DSS package for MATLAB ... DSS Matlab package contains algorithms for performing linear, ...
    (comp.soft-sys.matlab)
  • Re: Links to MATLAB Free Toolboxes
    ... Hybrid Toolbox. ... YALMIP is a MATLAB toolbox for rapid prototyping of optimization ... The package initially focused on semi-definite programming, ... > DSS Matlab package contains algorithms for performing linear, ...
    (comp.soft-sys.matlab)

Loading