This formula can be applied to the quadrilateral satisfying A+B \ne \pi and C+D \ne \pi, including convex, concave, and even self-intersecting cases.
I’d like to know the applicable case , inapplicable case and reasons for the validity of those cases. Are there any known papers or more elegant ways to derive this formula?I guess there are many ways to explain those reasons. It greatly resembles S = \frac{1}{2}(ab \sin B + cd \sin D). It seems that b and d can be determined using a, c, A, B, C, D.
This follows cleanly from the law of sines on each triangle formed by a diagonal. b and d are indeed determined (up to the constraint A+B+C+D=2π), and the formula breaks down when A+B=π or C+D=π because the diagonal length becomes indeterminate (parallel opposite sides, essentially a degenerate split).