Research

What I worked on

Observation-equivariant process geometry

Data are usually indirect observations of an underlying process, and the observation distorts its geometry. Standard geometric tools inherit that distortion. We instead learn the process geometry, its carré du champ (local covariance), from samples of data perturbations, such as the steps of a time series.

This recovers the geometry of the process, and the samples needed to learn its tangent spaces grow with the intrinsic dimension of the system, not with that of the observation. The transformation law also lets the geometry be learned from several observations of the same process, even in different spaces or modalities, and pushed forward to new ones, such as a latent space.

Observation-space distance

Intrinsic distance

distance from to intrinsic 1.51observation space 2.46

Both panels show the same states at the same positions. Arrow keys move a cross over the cloud; hold Shift to move further. Space or Enter grabs the cloud at the cross, so that the arrow keys pull it, and drops it again; Escape cancels. M measures from the point under the cross. Every pull is small and smooth, so the change of observation stays one-to-one.

Fig. 1States of a diffusion in the plane, seen through an observation you can change. Colour is distance from the marked point: in the observation space it changes with the observation; intrinsically it stays the same, while the local covariance G (the orange ellipse) transforms with the observation.

Topological deep learning

Many complex systems, brain networks among them, are organized by directed, multi-way interactions that pairwise graphs miss. We introduced a notion of higher-order directionality, and neural networks that process information along these directed, possibly asymmetric higher-order interactions: directed simplicial neural networks, and semi-simplicial neural networks for directed higher-order motifs, with applications to brain activity decoding. We also contributed to the open-source libraries TopoX and TopoBench, and to the topological deep learning challenges.

Directed flag complex

7 triangles and one directed 3-cycle. R 2 down 0 2: 5 steps in 2 paths.

Arrow keys move between arrows; Enter or Space reverses one. Light particles move along the paths of the relation shown; Pause stops them.

Fig. 2The arrows decide which triangles exist (a directed 3-cycle forms none, dashed) and the order of their corners: 0 source, 1 middle, 2 sink. Two triangles that share an edge may be related by which face of each it is.

Other collaborations

Equivariant, multimodal re-assembly of fragmented 3D objects, and the expressivity of piecewise-affine networks — how many affine regions trained networks actually use as tasks become harder.