Big Data Processing for I-LOFAR: REALTA

I-LOFAR is a true ‘big data’ project, and as part of the International LOFAR Telescope, is a pathfinder telescope to the future Square Kilometre Array telescope, which will create perhaps the largest dataset in the world (an exabyte per day!).

To date, the data processing capabilities of  I-LOFAR have not  been sufficient to allow the telescope study astronomy objects that vary rapidly. However,  members of the I-LOFAR consortium at UCC and NUIG have recently obtained SFI funding to create a data processing system that can intensively analyse  and rapidly store the data stream as it emerges from the telescope, giving I-LOFAR a new and powerful capability to study the transient radio sky.  The system, called the “REALtime Transient Acquisition Cluster (REALTA)”, builds on the heritage of the ARTEMIS system designed by the Oxford e-Research Centre.

In July 2018, a team from UCC, NUIG, TCD and Oxford/Berkeley team set up 5 Dell-EMC PowerEdge GPU/CPU blades and up to 300 terabytes of storage. Over the coming months, this will enable us to study a wide range of fascinating astronomy targets such as aurora in planetary atmospheres, pulsars, solar radio bursts, nova explosions, and fast radio bursts.

The I-LOFAR processing cluster may even be used to assist in the Search for Extraterrestrial Intelligence (SETI), in collaboration with the Breakthrough Listen foundation.

I-LOFAR and REALTA are supported by research infrastructure grants from Science Foundation Ireland. REALTA is owned by UCC and NUIG and hosted at TCD’s Rosse Observatory.

Technical specifications for REALTA can be found in the table below.

* This 110TB is distributed across REALTA’s 4 compute nodes
Compute Nodes (x4) Storage Node Headnode
Machine Name Dell Poweredge R740XD Dell Poweredge R730XD SuperMicro 1029U-TRTP2
CPU Model Intel Xeon Gold 6130 Intel Xeon E5-2640 Intel Xeon Silver 4110
CPU Clock Speed 2.10GHz 2.40GHz 2.10GHz
No. CPU Cores 64 40 32
RAM 256GB 256GB 93GB
Storage 110TB* 128TB N/A
GPU 16GB NVIDIA Tesla V100 N/A N/A

The figure below shows the individual hardware components of REALTA on the right and how they are connected to the data stream from I-LOFAR on the left.

Block diagram of REALTA hardware and network connection to I-LOFAR.