Questions tagged [optimal-control]
Optimal control theory, an extension of the calculus of variations, is a mathematical optimization method for deriving control policies. (Def: http://en.m.wikipedia.org/wiki/Optimal_control)
1,068 questions
2 votes
0 answers
108 views
How to solve this kind of constraint optimization problem? [closed]
Given distance $S$, time $T>0$ and bounds on the velocity $v_{\min}<v_{\max}$, $$ \begin{array}{ll} \underset{v:[0,T] \to {\Bbb R}}{\text{minimize}} & \displaystyle \int_0^T f(v(t),e(s(t),t))...
1 vote
0 answers
67 views
Solution to a constrained optimal control problem — is $v(t) = \frac{S}{T}$ optimal? [closed]
Given distance $S$, time $T > 0$ and bounds on the velocity $v_{\min} < v_{\max}$, $$ \begin{array}{ll} \underset{v : [0, T] \to {\Bbb R}}{\text{minimize}} & \displaystyle\int_0^T f (v(t),t) ...
4 votes
1 answer
64 views
Are the motion equations of an optimal control problem geodesics on a manifold?
Let us consider a Lagrangian system for which the equations of motion come from Hamilton's principle and are such that the control variable $\tau$ equals the equations of motion of a free system, ...
0 votes
0 answers
24 views
Adjoint state coming from Pontryagin Maximum Principle is normal to the attainable set - Reference Search
Given an optimal control problem $$ \begin{cases} \min_{u} &\int_s^T \ell(x(t), u(t)) \, dt + g(x(T))\\ \text{s.t.} & \dot{x}(t) = f(x(t),u(t))\\ & x(s) = x_0\\ & u \in \mathcal{A}\...
2 votes
1 answer
79 views
Optimal betting strategy to reach 8 points before 0 with success probability 0.4
I am studying a variant of the gambler’s ruin problem and would like help formulating and solving it optimally. A student starts with an initial capital of 3 points. To pass the exam, he must reach 8 ...
0 votes
0 answers
30 views
Continuity of an optimal stopping value with discontinuous gain function.
I am trying to approach this homework on optimal stopping. Suppose we have an optimal stopping problem where we observe the process $$dm_t = \frac{1}{1+t}dW_t,$$ where $W_t$ is a standard Brownian ...
0 votes
1 answer
53 views
How to apply Pontryagin's principle to a certain minimum-time problem
Background I'm trying to solve an optimal control problem using Pontryagin's Principle. The problem involves finding a control function that minimizes the time from a given initial state to a given ...
0 votes
0 answers
87 views
Why Is it Difficult to Ensure Stability for RL-based Control Algorithms?
For context, I am a layman, although I do have some background in basic college differential equations and linear algebra. I read that one of the drawbacks of control methods based on reinforcement ...
0 votes
1 answer
92 views
Optimal Control w/ Control Equality Constraints
Let's say I have an optimal control problem of the following for: \begin{align*} &\max_{\vec{u}}\int_a^bf(\vec{x}(t),\vec{u}(t))\,dt\\[10pt] \text{subject to:}&\qquad \frac{d\vec{x}}{dt}(t) = \...
13 votes
2 answers
1k views
Proof of shortest path avoiding ball
I have read in a number of places that the shortest path between two points $a,b\in \mathbb{R}^2$ that avoids a disk $D$ between them (by "between" I mean the disk intersects the line $a-b$) ...
1 vote
0 answers
88 views
Minimization with implicit dependency over function spaces
Technically, I am working on an optimal control problem. However, through some trickery, I managed to eliminate the dynamics. What I am left with is the following minimization problem: $$ \min_{g \in ...
0 votes
0 answers
49 views
Stochastic Optimal Control: Example of problem with no optimal control
I have a problem with the proof of Exercise 4.17 iv) in the following script: https://www.maths.ed.ac.uk/~dsiska/LecNotesSCDAA.pdf Here I state the Exercise as in this script together with the ...
0 votes
1 answer
49 views
Finding an optimal interpolation subject to some boundary constraints
Let $s\in \left(0, 1\right)$, and consider the task of finding the 'nicest-possible' function $f$ such that $f(0) = 0, f^\prime (0) = s$, and $f(1) = 1, f^\prime (1) = 0$, where 'niceness' is framed ...
1 vote
1 answer
138 views
Why does a Luenberger observer require observability?
I have the following misunderstanding regarding observability and observer. Observability of a linear dynamical system is the same as the "recoverability" of the initial condition $x(0)$. A ...
7 votes
0 answers
342 views
Kalman Filter with correlated measurement noise derivation
I have made great efforts on the derivation, and the results are really close but I am still missing the last step. If someone can help that'd be great! Problem setup Consider this modified Kalman ...