While machine translation has greatly improved, an embedded lightweight energy-efficient hardware remains elusive because existing solutions based on artificial neural networks (NNs) are computation-intensive and energy-hungry requiring server-based implementations, which also raises data protection and privacy concerns.

 

Today, 2D electronic architectures suffer from "unscalable" interconnects, making it difficult for them to compete with biological neural systems in terms of real-time information-processing capabilities with comparable energy consumption. Recent advances in materials science, device technology and synaptic architectures have the potential to fill this gap with novel disruptive technologies that go beyond conventional CMOS technology.

 

A promising solution comes from vertical nanowire field-effect transistors (VNWFETs) to unlock the full potential of truly 3D neuromorphic computing performance and density.

 

Through actual VNWFETs fabrication setting up a design-technology co-optimization approach, the FVLLMONTI vision is to develop regular 3D stacked hardware layers of NNs empowering the most efficient machine translation thanks to a fine-grain hardware / software co-optimisation. FVLLMONTI consortium is a strong partnership with complementary expertise and extensive track-records in the fields of nanoelectronics, unconventional logic design, reliability, system‐level design, machine translation, cognition sciences. The consortium is composed of 50% of junior researchers and 90% of first-time participants to FETPROACT.  

 

FVLLMONTI is organized around 4 specific objectives (OBJ) targeting 12 Key Performance Indicators (KPI) mastered through 16 Milestones (MS):

 

Objective 1: Compactness: From fabricated low-complexity hardware to minimal neural network compute cube (N2C2)

Specific objective 1 (OBJ1) concentrates on the compactness of the elements in the FVLLMONTI value chain from low-level logic blocks up to a critical compute function in N2C2 to ensure the computation resource footprint.

 

Objective 2: Performance: Energy-delay-product assessment of the computational layer, the embedded Non-Volatile Memory (e-NVM) and interconnects

Specific Objective 2 (OBJ2) is designed to quantify the conventional figure-of-merit energy-delay-product (EDP) towards fast and ultra-low-power data transfer between the e-NVM using ferroelectric-gated VNWFET and the computing layer, thereby addressing the whole FVLLMONTI value chain from low-level logic blocks up to a critical compute function in N2C2.

 

Objective 3: Validation of the VNWFET technology for live English-French streaming speech recognition to text

Specific Objective 3 (OBJ3) focuses on exploring the use of VNWFET-based 3D logic cells and e-NVM blocks in multiple layers of NNs enabling ultra-compact and energy-efficient Transformers NNs for Automatic Speech Recognition (ASR) and Machine translation (MT). Their compactness and EDP will be compared with general-purpose architectures with CNN accelerators. To validate the approach, the target application is live English-French streaming speech recognition to text.

 

Objective 4: 3D NN architecture robustness

Specific Objective 4 (OBJ4) assesses the reliability of VNWFET devices at the early step of their development. The impact of the identified wear out failure mechanisms will be appraised on the whole FVLLMONTI value chain: N2C2, 3D NN architecture and up to the ASR and MT application. Beyond the specific translation application, the final intent is to demonstrate the intrinsic 3D NN architecture robustness.

KPI4: EDP assessment for JL VNWFETs, ION of at least 300 µA/µm at a supply voltage below 0.9V with scaled gate length

KPI5: EDP assessment for PC VNWFETs, ION of at least 10 µA/µm at a supply voltage below 2 V

KPI6: EDP assessment for read and write operation of a single transistor ferroelectric VNWFET cell with 3 V write voltage and 2 V operation voltage or below

KPI7: EDP assessment of 1-bit FA designs exploiting reconfigurability and/or e-NVM function

KPI8: NN compression size

KPI9: For ASR and MT 

KPI10: Word Error Rate (WER) on read English and French

KPI11: Bi-Lingual Evaluation Understudy (BLEU) score

KPI12: Intrinsic 3D NN architecture robustness, irrespective of the application: Architectural Vulnerability Factor (AVF)  

 

video / video

partners / contact

UNIVERSITE DE BORDEAUX

[ UBx ]

France

Cristell MANEUX

Cristell MANEUX

Project Coordinator. Full Professor at IMS Laboratory, Department of Sciences and Engineering, University of Bordeaux, France.

CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS

[ CNRS-LAAS ]

France

Guilhem LARRIEU

Guilhem LARRIEU

WP1 Leader. Research Director at Laboratory for Analysis and Architecture of Systems, CNRS-LAAS, France.

ECOLE CENTRALE DE LYON

[ ECL-INL ]

France

Ian O'Connor

Ian O'Connor

WP4 Leader. Distinguished Professor at Ecole Centrale de Lyon, France.

GLOBAL TCAD SOLUTIONS GMBH

[ GTS ]

Austria

Oskar BAUMGARTNER

Oskar BAUMGARTNER

WP3 Leader. Chief Operating Officer at Global TCAD Solutions GmbH, Austria.

ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE

[ EPFL ]

Switzerland

David ATIENZA

David ATIENZA

WP5 Leader. Professor and Director of Embedded Systems Laboratory, EPFL, Switzerland.

NAMLAB GGMBH

[ NLB ]

Germany

Jens TROMMER

Jens TROMMER

WP6 Leader. Senior Scientist Emerging Devices at NaMLab gGmbH, Germany.

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101016776.

graph - chart

Start 01/01/2021
60% 01/10/2023
End 31/08/2025
Budget allocation . M€ Budget allocation
Effort 637 p*m Effort
Effort 11 persons Full time equivalent

news

European Night of Research participation - Bordeaux, France

2023-09-29

View more

EMRS - Fall meeting

2023-09-18

View more

ESSDERC ESSCIRC - Workshop participation

2023-09-11

View more

2nd Advisory Board Meeting

2023-07-04

View more

E3AI Summer school - Event kick-off

2023-06-19

View more

GRD SOC2 Colloque 2023 - Participation

2023-06-12

View more

243rd ECS Meeting and 18th International Symposium on Solid Oxide Fuel Cells

2023-05-30

View more

Plenary Progress Meeting in Lausanne

2023-03-23

View more

E3AI Summer School - Program online !

2023-03-01

View more

E3AI Summer School - Save the date

2022-12-20

View more

Meet FVLLMONTI Experts at IEDM 2022

2022-12-05

View more

Visit Prof. Hermann Ney in Bordeaux

2022-10-19

View more

Full day progress meeting in Bordeaux

2022-09-13

View more

Invited talk at the Design Automation and Test in Europe (DATE) 2022

2022-03-15

View more

HiPEAC Article on FVLLMONTI now available

2022-02-10

View more

Workshop at the HiPEAC Computing System Week

2021-10-26

View more

1st Advisory Board meeting (Bordeaux, France)

2021-06-21

View more

Invited paper at IEDM 2021, the 67th Annual International Electron Devices Meeting

2021-06-14

View more

FVLLMONTI Presentation at NEUROTECH - Video

2021-05-10

View more

NEUROTECH online event - Participation

2021-04-26

View more

events

2023-11-15

Plenary Progress Meeting n°5

From the 15/11/2023 to the 16/11/2023, at Vienna, Austria.

The purpose of this meeting is to review the progress of our ongoing FVLLMONTI project, and to ensure that we remain on track towards our shared goals.

Over the course of this meeting, we discussed the issues that our WPL have faced since march 2023, the implemented solutions to solve them, and the ideas or concrete steps that we need to implement, in order to continue moving forward.

It is also an opportunity to share knowledge and expertise too, with view to prepare the second EU review, incoming in february 2024; and ensure that we are all working together effectively to produce innovative, quality, scientific research; respecting our legal and financial obligations towards the European commission. 

2023-07-04

2nd Advisory Board Meeting

The secondAdvisory Board meeting of the FVLLMONTI project took place on 4 of July 2023. It has been tenued during a Zoom remote session. 

We've got the pleasure to welcome our new AB Member for the first time: Gérard CHOLLET.  

AB Members representing: 

  • CEA-Leti: Thomas Ernst
  • TSMC: Katherine Chiang
  • Thales avionics: Sylvain Hourlier
  • NUI Galwa Data Science Institute: John McCrae
  • Nanyang Technology University: Mohamed Sabry Aly
  • CNRS, Emeritus Dir: Gérard Chollet

2023-06-19

Energy Efficient Embedded AI - Bordeaux Summer School

Bordeaux Summer School
19/06/2023-23/06/2023

The E3AI summer school is open to second year Master students, doctoral students, post-doctoral fellows, researchers and professionals with an interest in embedded artificial intelligence, deep learning, neuromorphic computing, natural language processing, spintronics and 6G communications.

Course content will address the consequent skill gap between embedded technology and deep learning applications, and will equip participants with the interdisciplinary knowledge and skills needed to develop innovative circuit architectures and execute data intensive applications on resource-constrained devices.

This summer school is supported by FVLLMONTIHermes and RadioSpin, three H2020 European projects, and is co-organised with the Green AI (GrAI) chair in artificial intelligence and the IEEE Circuits and Systems Society. The event is the first in a series of similar bi-annual events organised by and for the Embedded Artificial Intelligence (EAI) transdisciplinary community.

https://bss-e3ai.u-bordeaux.fr/en/

2023-03-22

Plenary Progress Meeting n°4

From the 22/03/2023 to the 23/03/2023, at the EPFL in Lausanne, Switerzland.

The purpose of this meeting is to review the progress of our ongoing FVLLMONTI project, and to ensure that we remain on track towards our shared goals.

Over the course of this meeting, we discussed the issues that our WPL have faced since months ago, the implemented solutions to solve them, and the ideas or concrete steps that we need to implement, in order to continue moving forward. It was for us an opportunity to share knowledge and expertise too; and ensure that we are all working together effectively to produce innovative, quality, scientific research.

2022-09-20

EU Review Meeting-Reporting Period 1

Holding our first review meeting with renowned European experts for our project, funded by the European Commission. Stay informed as we share updates and insights from this collaboration, shaping the future of groundbreaking solutions.

The purpose and role of EU experts in a review meeting for an EU funded project are to assess the project's progress, achievements, and compliance with the set objectives and guidelines, providing valuable feedback and recommendations to ensure its successful implementation and alignment with EU's objectives

You can have access to the project related EU data. We invite you to take information of all our activities and general frame of our activities on:
https://cordis.europa.eu/project/id/101016776/fr

2022-01-31

Plenary Progress Meeting n°3

In the general project lifecycle progresses, at M12, the purpose of this meeting is to review the progress of our ongoing FVLLMONTI project, one year after its kick-off, and to ensure that we remain on track towards our shared goals.

Over the course of this meeting, we discussed the issues that our WPL faced since the last PPM, the implemented actions done until the meeting.It was for us an opportunity to ensure that we are all working together effectively to produce innovative, quality, scientific research.

2021-09-07

Plenary Progress Meeting n°2

A one day progress meeting, tenued at the University of Bordeaux, France

The purpose of this meeting is to review the progress of our ongoing FVLLMONTI project, and to ensure that we remain on track towards our shared goals.

Over the course of this meeting, we discussed the issues that our WPL faced since the begining of the project, the implemented actions done until the meeting, and the ideas or concrete steps that we need to implement, in order to continue moving forward. It was for us an opportunity to ensure that we are all working together effectively to produce innovative, quality, scientific research.

2021-06-21

1st Advisory Board Meeting

The first Advisory Board meeting of the FVLLMONTI project took place on 21 of June 2021 at the Laboratoire de l'Intégration du Matériau au Système (IMS) in Bordeaux (France). Also, a remote session was available. 

AB Members representing: 

  • CEA-Leti: Thomas Ernst
  • TSMC: Katherine Chiang
  • Thales avionics: Sylvain Hourlier
  • NUI Galwa Data Science Institute: John McCrae
  • Nanyang Technology University: Mohamed Sabry Aly

2021-03-09

Plenary Progress meeting n°1

With view to frame the general habits, ways of working and practices which permit a well follow-up and management of our project lifecycle: a general meeting has been tenued, to inform all our partners about the decided process to follow in question.

Project management centred meeting axis.

Georgetta BORDEA is in charge of the project management. Working with Cristell Maneux as WP7 Leaders, both of them created the FVLLMONTI way of doing. 

  • Performance & Excellence
  • Communication
  • Trust & Resilience
  • Respect for everyone's time
  • Professionnalism & Habits

2021-02-25

FVLLMONTI project Kick-off Meeting

The mission and objective of this meeting is to take advantage of, lay the foundations for, and take up the challenges that the consortium may face in the various sectors of activity targeted by its intervention and research, for the project but above all in the projections for the future of which it is the subject.

We're a diverse, skilled consortium, ready to drive innovation and foster collaboration.

Meeting discussion points expectations:

Project Overview: Goals and scope framing.
Work Packages: Divide tasks and set a common timeline.
Resource Allocation: Fix the allocate funds and personnel concerns.
Ethical Considerations: AI related concerns and developpement framing.
Risk Management: Mitigate potential setbacks and fix risks.
Communication: Foster open collaboration within and outside the consortium.
Data Management: Secure and comply with GDPR.
Dissemination: Share findings and maximize impact.

publications

Transformer model compression for end-to-end ...

2022-08-29

Leila Ben Letaifa, Jean-Luc Rouas

View more

Extraction of small-signal equivalent circuit...

2022-08-01

Bruno Neckel Wesling, Marina Deng, Chhandak Mukherjee, Magali de Matos, Abhishek Kumar, Guilhem Larrieu, Jens Trommer, Thomas Mikolajick, Cr...

View more

Challenges in Electron Beam Lithography of Si...

2022-07-04

Cigdem Cakirlar, Giulio Galderisi, Christoph Beyer, Maik Simon, Thomas Mikolajick, Jens Trommer

View more

Reconfigurable Field Effect Transistors: A Te...

2022-05-11

T Mikolajick, G Galderisi, S Rai, M Simon, R Böckle, M Sistani, C Cakirlar, N Bhattacharjee, T Mauersberger, A Heinzig, A Kumar, WM Web...

View more

On the Modeling of Polycrystalline Ferroelect...

2022-04-29

Authors: Thesberg, Mischa; Alam, Md Nur K.; Truijen, Brecht; Kaczer, B.; Roussel, Philippe. J.; Stanojevic, Zlatan; Baumgartner, Oskar; Scha...

View more

Compact Modeling of 3D Vertical Junctionless ...

2021-01-01

Mukherjee, C., Larrieu, G., Maneux, C. 2020 Joint International EUROSOI Workshop and International Conference on Ultimate Integration o...

View more

3D Logic Cells Design and Results Based on Ve...

2021-01-01

Poittevin, A., Mukherjee, C., O’Connor, I., Maneux, C., Larrieu, G., Deng, M., Le Beux, S., Marc, F., Lecestre, A., Marchand, C., Kuma...

View more

Single-step reactive ion etching process for ...

2021-01-01

Tom Mauersberger, Jens Trommer, Saurabh Sharma, Martin Knaut, Darius Pohl, Bernd Rellinghaus, Thomas Mikolajick, André Heinzig

View more

Modelling of vertical and ferroelectric junct...

2021-01-01

C. Maneux, C. Mukherjee, M. Deng, M. Dubourg, L. Reveil, G. Bordea, A. Lecestre, G. Larrieu, J. Trommer, E.T. Breyer, S. Slesazeck, T. Mikol...

View more

Compact modeling of 3D vertical junctionless ...

2021-01-01

Mukherjee, C., Poittevin, A., O'Connor, I., Larrieu, G., Maneux, C.Solid-State Electronics, 183, art. no. 108125.

View more

3D Logic Cells Design and Results Based on Ve...

2021-01-01

Mukherjee, C., Deng, M., Marc, F., Maneux, C., Poittevin, A., O'Connor, I., Beux, S.L., Marchand, C., Kumar, A., Lecestre, A., Larrieu,G...

View more

Patterning and integration issues of doped na...

2021-01-01

Abhishek Kumar, Aurélie Lecestre, Jonas Müller , Guilhem Larrieu

View more

documents

Article - HiPEAC Conference 2022

D.1.1_FVLLMONTI_P2-Larrieu-20220902_Elementary VNWFET devices – JL

D.2.1_FVLLMONTI_P1-MUKHERJEE-230531_Thermal impedance and trap extraction

D.2.3 Parasitic Element Extraction - This document describes an elaborate methodology for the extraction of the extrinsic parasitic interconnects of the FVLLMONTI technology.

D.3.1 Technology description for TCAD & DTCO - This document describes the initial technology definition of the VNWFET architecture options to be used and shared between the project partners. The technology definition consists of a basic set of descriptive files that allows automated creation of a 3D TCAD structure from a 2D mask layout (typically given in GDSII format).

D.4.1_FVLLMONTI_P3 ECL_Library of optimized VNWFET-based logic cells

D.4.5 Virtual scalable N2C 2 design and Pareto-front data - This document describes the first version of the virtual scalable Neural Network Compute Cube (N2C2). Its principal function is to carry out element-wise non-volatile matrix multiplication, accumulation and activation through a non-linear function.

D.5.1 Pre-trained speech ASR/MT model and use cases - V1 - This document presents the achievements of the WP5 partners during the first semester of the FVLLMONTI project. In this period, work has focused on developing Automatic Speech Recognition (ASR) and Machine Translation (MT) systems using state-of-the-art methods, including neural network transformer architecture.

D.5.3 Architecture library multi-objective trade-offs and calibrated thermal models V1 - First version of architecture library, multi-objective trade-offs and calibrated thermal models

D.5.5 Co-optimized hardware-NN architecture for ASR MT V1 - First report on the co-optimized hardware/NN architecture for ASR/MT

D.6.1_FVLLMONTI_P6-NLB-20210831 - Project Website and social networks accounts for FVLLMONTI are visible online.

D.6.2 Plan for dissemination of the results – Year 1 - This Dissemination strategy gathers together all information regarding the dissemination of the FVLLMONTI project. The strategy helps conducting the dissemination and communication activities throughout the project by acting as a practical and regularly updated guide for the project members.

D.6.3 Plan for dissemination of the results – Year 2 - This Dissemination strategy gathers together all information regarding the dissemination of the FVLLMONTI project. Dissemination activities over the first two years of the project are summarized and quantified.

D.6.6 Data Management Plan - The FVLLMONTI Data Management Plan describes datasets generated and published during the duration of the project, providing an outline for handling data during the duration of the project and after the project is completed. This document provides a short summary of each dataset, describing how data will be made findable, accessible, interoperable, and reusable following the FAIR data principles. Finally for each dataset we consider how related costs will be covered and discuss data security and ethical aspects.

D.6.7 Technology impact and exploitation innovation – Year 1 - This document describes the initial technology impact and exploitation action assessment associated with FVLLMONTI. The aims and visions of the project are set into the bigger overall socioeconomic context. It is described why the disruptive N2C2 concept based on emerging nanowire technologies can change the neuromorphic circuit market. Current market size and segmentation, as well as competitor technologies, are referenced.

D.6.8 Technology impact and exploitation innovation – Year 2 - This document describes the first updated assessment of technology impact and exploitation action assessment associated with FVLLMONTI. It is described why the disruptive N2C2 concept based on emerging nanowire technologies can change the neuromorphic circuit market and ranks the key innovations targeted in the project.

D.7.1 Project handbook - This project management handbook describes the project organisation and internal procedures of the FVLLMONTI project. This document aims to provide a written collection of rules that will govern the work of the consortium and a set of tools needed to facilitate the day-to-day management of the project.

FM Symbol - png

Invited Presentation - FETCH Conference 2023 C. Maneux - Invited Presentation at FETCH Summer School 2023. How to reinvent the value chain with emerging technologies and new computing paradigms? Challenges in characterization, modelling and circuit design.

Leaflet Back

Leaflet Front

contact us

By submitting this form, I agree that the information entered may be used for newsletter subscriptions, information requests and statistical analysis that may result. Under no circumstances will these data be transferred to third parties.
To know and exercise your rights, in particular to withdraw your consent to the use of data collected by this form, please consult our general conditions of use.

project netboard login

project netboard login