2023/2024

Signatures for Images

Mathematics
Signatures for Images illustration. Fragmented glass with RW.

Principal investigators

Kurusch Ebrahimi-Fard

Professor
Norwegian University of Science and Technology (NTNU)
Year at CAS
Research Area
Mathematics

Fabian Nøst Harang

Professor
Norwegian Business School (BI)
Year at CAS
Research Area
Mathematics

Abstract

Over the past decade, the path signature has emerged a powerful tool in data science, particularly for time series analysis and pathwise stochastic calculus, due to its efficient computability via dynamic programming based on Chen’s identity. We define signature for images by extending the concept of path signature — a particular 1-parameter object derived from iterated integrals along paths — to surfaces by introducing a second parameter. This extension involves iterated surface integrals, which adds significant complexity. Our research identified two distinct approaches to defining surface signature. The first, recursively defined via integral-type equations, satisfies a Chen-type relation and a shuffle-type product, while exhibiting continuity, as well as invariance to stretching, translation, and rotation. It also possesses a universal approximation property. Notably, this approach has already inspired follow-up work, demonstrating its practical value in image analysis. The second approach, on the other hand, is based on the non-commutative Stokes’ theorem and draws inspiration from higher gauge theory, an advanced topic in modern mathematical physics. It employs crossed modules of Lie groups and Lie algebras to capture surface features extending beyond line integrals along boundary loops. Further developments include a Magnus-type expression for the logarithm of the surface signature and a sewing lemma in the crossed module framework, paving the way for new directions in image analysis.

Fellows

Yvain Bruned

Professor
University of Lorraine
Year at CAS

Ilya Chevyrev

Reader
University of Edinburgh
Year at CAS
Research Area
Mathematics
profile image illustration

Christa Cuchiero

Professor
University of Vienna
Year at CAS
Research Area
Mathematics /
Stochastic Analysis

Joscha Diehl

Professor
University of Greifswald
Year at CAS
Research Area
Mathematics

Frédéric Patras

Research Director
University Côte d'Azur & CNRS
Year at CAS

Fride Straum

PhD Candidate
Norwegian University of Science and Technology (NTNU)
Year at CAS

Samy Tindel

Professor
Purdue University
Year at CAS

News

After co-leading the "Signatures for Images" project at CAS, mathematician Fabian Harang is now tackling climate challenges in the grocery industry - connecting basic research and business interests.

BI Norwegian Business School has launched "AMOR – Center for Applied Mathematics and Operations Research," a new research center led by former CAS PI and mathematician Fabian Harang. The center has been made possible through funding from Reitan Retail and Rema 1000.

Kurusch Ebrahimi-Fard, Professor at the Department of Mathematical Sciences at the Norwegian University of Science and Technology (NTNU) and Fabian Nøst Harang, Professor in Mathematics at BI Norwegian Business, is co-leading the CAS project "Signatures for Images" this academic year. This unique initiative aims to build mathematical foundations for image classification, leveraging iterated-integrals signature in the context of rough paths theory. It’s a venture at the intersection of algebra, stochastic analysis, and geometry, involving experts in machine learning to explore real-world applications and investigate the statistical properties of image signatures.