• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site

HSE Researchers Introduce Novel Symmetry-Aware Neural Network Architecture

HSE Researchers Introduce Novel Symmetry-Aware Neural Network Architecture

© iStock

Researchers at the HSE Laboratory for Geometric Algebra and Applications have developed a new neural network architecture that can accelerate and streamline data analysis in physics, biology, and engineering. The scientists presented their solution on July 16 in Vancouver at ICML 2025, one of the world's leading conferences on machine learning. Both the paper and the source code are publicly available.

Many physical systems—from robots to molecules to charged particles—exhibit the same behaviour when rotated or mirrored. Modern equivariant neural networks are specifically designed to recognise and preserve such symmetries in data, making them especially valuable for scientific and technological applications ranging from modelling chemical compounds and analysing physical processes to image recognition.

However, these models have a drawback: their high accuracy comes at the cost of increased complexity. They often require a large number of trainable parameters, making them resource-intensive and prone to overfitting—especially when training data is limited.

Ekaterina Filimoshina and Dmitry Shirokov, researchers at the Department of Mathematics and the Laboratory for Geometric Algebra and Applications of the HSE Faculty of Economic Sciences, have developed GLGENN (Generalized Lipschitz Group Equivalent Neural Networks), a neural network architecture designed to overcome these limitations. It enables models to preserve data symmetries using significantly fewer parameters. The authors based their design on the well-established mathematical framework of Clifford (geometric) algebras and introduced a novel weight-sharing technique that respects the underlying algebraic structures.

'We set out to design a model that is both intelligent and lightweight,' says Ekaterina Filimoshina, Research Assistant at the HSE FES Laboratory for Geometric Algebra and Applications. 'GLGENN demonstrates that equivariant neural networks don’t need to be large and complex—they can learn effectively, even from limited data, without compromising quality.'

The diagram illustrates that GLGENN is ‘symmetry-aware’: rotating the data either before or after processing by the model yields the same result.
© E. Filimoshina, D. Shirokov: GLGENN: A Novel Parameter-Light Equivariant Neural Networks Architecture Based on Clifford Geometric Algebras

The model has been tested on a variety of tasks, ranging from simulating physical processes to handling geometric data, and has demonstrated results comparable to or better than existing methods. Additionally, GLGENN operates faster and more efficiently due to its reduced number of trainable parameters, making it more accessible for practical applications.

Dmitry Shirokov

'These results could mark a significant step toward the development of new neural-network tools for science and technology' adds Dmitry Shirokov, Head of the HSE FES Laboratory for Geometric Algebra and Applications. 'We are confident that the geometric-algebra approach will find applications across a wide range of fields, including bioinformatics, robotics, and geoinformatics.'

Ekaterina Filimoshina's presentation at ICML
Photo from personal archive

Participation in ICML served as recognition of the high level of machine learning research conducted at HSE University. The scientists plan to further develop the GLGENN architecture by expanding its capabilities to handle new types of data and exploring its potential applications in physics, robotics, and computer vision.

The study was supported by the HSE Mirror Laboratories project titled 'Quaternions, geometric algebras, and applications.'

See also:

How the Brain Processes a Word: HSE Researchers Compare Reading Routes in Adults and Children

Researchers from the HSE Center for Language and Brain used magnetoencephalography to study how the brains of adults and children respond to words during reading. They showed that in children the brain takes longer to process words that are frequently used in everyday speech, while rare words and pseudowords are processed in the same way—slowly and in parts. With age, the system is reorganised: high-frequency words shift to a fast route, whereas new letter combinations are still analysed slowly. The study was published in the journal Psychophysiology.

How Neural Networks Detect and Interpret Wordplay: New Insights from HSE Researchers

An international team including researchers from the HSE Faculty of Computer Science has presented KoWit-24, an annotated dataset of 2,700 Russian-language Kommersant news headlines containing wordplay. The dataset enables an assessment of how artificial intelligence detects and interprets wordplay. Experiments with five large language models show that even advanced systems still make mistakes, and that interpreting wordplay is more challenging for them than detecting it. The results were presented at the RANLP conference; the paper is available on Arxiv.org, and the dataset and the code for reproducing the experiments are available on GitHub.

HSE Physicists Propose Unified Theory for Describing Electric Double Layer

To develop more efficient batteries and catalysts, it is essential to understand the processes occurring at the metal–solution interface in the electric double layer (EDL). Physicists at HSE MIEM have proposed a unified theoretical model of the EDL that simultaneously accounts for selective adsorption of ions on the surface and partial charge transfer between ions and the metal—phenomena that had previously been described separately. The model’s predictions are consistent with experimental data. In the future, it may be used in the development of batteries, supercapacitors, and catalysts. The study has been published in Electrochimica Acta. 

HSE Researchers Experimentally Demonstrate Positive Effects of Urban Parks on the Brain

Scientists at HSE University have investigated the effect of parks on the cognitive and emotional resources of city dwellers. The researchers compared brain electrical activity in 30 participants while they watched videos of walks through parks and along busy highways. The results showed that green urban environments with trees produce a consistent effect across individuals, helping the brain calm down and relax. By contrast, walks along busy streets were found to be distracting. The findings have been published in Scientific Reports.

'Our Research Is Primarily Focused on Developing Lasers as Carriers of Information'

The International Laboratory of Quantum Optoelectronics at HSE University–St Petersburg develops semiconductor microlasers. The components and systems created by the laboratory also enable high-speed data transmission and processing. Natalia Kryzhanovskaya, Head of the Laboratory and Doctor of Sciences in Physics and Mathematics, spoke with the HSE News Service about the laboratory’s research areas and future prospects.

HSE to Launch Laboratories in Space Research and Nanoelectronics with One of India’s Top Universities

Scientists from the HSE University and the Indian Institute of Technology Bombay (IIT Bombay) will carry out joint research in the storage, transmission, and processing of data in space systems. A second major project will be a laboratory for superconducting spintronics—a promising field in modern nanoelectronics.

Scientists Show That Peer Influence Can Be as Effective as Expert Advice

Eating habits can be shaped not only by the authority of medical experts but also through ordinary conversations among friends. Researchers at HSE University have shown that advice from peers to reduce sugar consumption is just as effective as advice from experts. The study's findings have been published in Frontiers in Nutrition.

HSE University Develops Tool for Assessing Text Complexity in Low-Resource Languages

Researchers at the HSE Centre for Language and Brain have developed a tool for assessing text complexity in low-resource languages. The first version supports several of Russia’s minority languages, including Adyghe, Bashkir, Buryat, Tatar, Ossetian, and Udmurt. This is the first tool of its kind designed specifically for these languages, taking into account their unique morphological and lexical features.

Language Mapping in the Operating Room: HSE Neurolinguists Assist Surgeons in Complex Brain Surgery

Researchers from the HSE Center for Language and Brain took part in brain surgery on a patient who had been seriously wounded in the SMO. A shell fragment approximately five centimetres long entered through the eye socket, penetrated the cranial cavity, and became lodged in the brain, piercing the temporal lobe responsible for language. Surgeons at the Burdenko Main Military Clinical Hospital removed the foreign object while the patient remained conscious. During the operation, neurolinguists conducted language tests to ensure that language function was preserved.

HSE Scientists Use MEG for Precise Language Mapping in the Brain

Scientists at the HSE Centre for Language and Brain have demonstrated a more accurate way to identify the boundaries of language regions in the brain. They used magnetoencephalography (MEG) together with a sentence-completion task, which activates language areas and reveals their functioning in real time. This approach can help clinicians plan surgeries more effectively and improve diagnostic accuracy in cases where fMRI is not the optimal method. The study has been published in the European Journal of Neuroscience.