NCN Completed

NCN Preludium

Acceleration of processing event-based visual data with the use of heterogeneous, reprogrammable computing devices

Akceleracja przetwarzania zdarzeniowych danych wizyjnych z wykorzystaniem heterogenicznych, reprogramowalnych układów obliczeniowych

Embedded Platforms Event Cameras Real-time SoC FPGA

Abstract

The aim of the proposed basic research is to design innovative methods of processing video data using modern neuromorphic sensors and heterogeneous MPSoC (Multiprocessor-System-on-Chip) devices. This should allow to increase the effectiveness of vision systems, reduce power consumption, and lower the latency of data processing. Event cameras are neuromorphic sensors that are inspired by the way the human visual organ works. Contrary to traditional cameras, the output does not provide whole frames, but only information about the pixels for which the brightness has changed. The sent data packet contains information about the pixel coordinates, the polarity of the change (change to lighter or darker), and a time stamp. The camera operating in this way has a number of advantages over classical cameras that sequentially send pixels belonging to the entire image frame, e.g., high temporal resolution, low latency, no redundant data, and high dynamic range. The main goal of the proposed research is the acceleration of event-based dynamic vision sensor data processing. Attempts will be made to propose hardware architectures for the most important components of a modern vision system for autonomous robots.

Publications

Year
Type
Project

2026

  1. Towards event-based in-cabin sensing: a synchronized dual-camera dataset pipeline
    Marcin Kowalczyk, Marek Dlugosz, Kamil Jeziorek, Mateusz Komorkiewicz, Tomasz Kryjak, and 4 more authors
    In KU KDM 2026 : eighteenth ACC Cyfronet AGH HPC users conference : Zakopane, 13–15 April 2026 : proceedings, 2026
  2. FPGA-based hardware architecture for contrast maximization in event-based vision
    Michal Filipkowski, Marcin Kowalczyk, and Tomasz Kryjak
    In Applied Reconfigurable Computing : architectures, tools, and applications : 22nd international symposium, ARC 2026 : Cagliari, Sardinia, Italy, April 8–10, 2026 : proceedings, 2026

2025

  1. KU KDM Preludium
    High-performance computing for event cameras: DIF filtering and graph convolutional networks for object classification
    In KU KDM 2025 : seventeenth ACC Cyfronet AGH HPC users’ conference : Zakopane, 2-4 April 2025 : proceedings, 2025
  2. MICPRO Preludium
    High throughput event filtering: the interpolation-based DIF algorithm hardware architecture
    Microprocessors and Microsystems, 2025
  3. CVPRW Preludium
    Learning from noise: enhancing DNNs for event-based vision through controlled noise injection
    In CVPRW 2025 : IEEE/CVF Computer Vision and Pattern Recognition Workshops : 11–15 June 2025, Nashville, [USA] : proceedings, 2025
  4. Live demonstration: Continuous processing of event-data with Graph Convolutional Neural Networks implemented for SoC FPGA
    In FPL 2025 : 35th International Conference on Field-Programmable Logic and Applications : 1–5 September 2025 Leiden, Netherlands : proceedings, 2025

2023

  1. CVPRW Preludium
    Interpolation-based event visual data filtering algorithms
    In CVPRW 2023 : 2023 IEEE/CVF conference on Computer Vision and Pattern Recognition Workshops : Vancouver, Canada 18-22 June 2023 : proceedings, 2023
  2. Zliczanie szybkich obiektów z wykorzystaniem kamery zdarzeniowej
    PAR Pomiary Automatyka Robotyka, 2023

2022

  1. Conference Preludium
    Exploration of hardware acceleration methods for an XNOR traffic signs classifier
    Dominika Przewlocka-Rus, Marcin Kowalczyk, and Tomasz Kryjak
    In Progress in image processing, pattern recognition and communication systems : proceedings of the conference (CORES, IP&C, ACS) – June 28–30 2021, 2022
  2. Hardware architecture for high throughput event visual data filtering with matrix of IIR filters algorithm
    In DSD 2022 : 25th Euromicro Conference on Digital System Design : 31 August – 2 September 2022, Maspalomas, Spain : proceedings, 2022
  3. Book chapter Preludium
    Systemy wizyjne w zastosowaniach przemyslowych
    Marek Gorgon, Maciej Aleksandrowicz, Krzysztof Blachut, Andrzej Brodzicki, Zbigniew Bublinski, and 20 more authors
    In Nauka – technika – technologia : seria wydawnicza AGH, 2022

2021

  1. A comparison of real-time 4K/UltraHD connected component labelling architectures
    In FPL 2021 : 31st international conference on Field-Programmable Logic and Applications : Dresden, Germany 30 August – 3 September 2021 : proceedings, 2021
  2. A connected component labelling algorithm for a multi-pixel per clock cycle video stream
    In 2021 24th Euromicro conference on Digital System Design : DSD 2021 : virtual conference, 1–3 September 2021 : proceedings, 2021
  3. Real-time FPGA implementation of parallel connected component labelling for a 4K video stream
    Marcin Kowalczyk, Piotr Ciarach, Dominika Przewlocka-Rus, Hubert Szolc, and Tomasz Kryjak
    Journal of Signal Processing Systems for Signal, Image, and Video Technology, 2021