Drowning in #Data
Issued by SPIE
The Square Kilometre Array is set to be the world’s biggest radio telescope and the largest big data project in the known Universe. Will astronomers sink or swim in the digital downpour?
Late last year, an international team of researchers used the world's most powerful supercomputer—Summit—to process simulated observations of the early Universe. A mighty 400 gigabytes of data were processed every single second, equivalent to streaming more than 1,600 hours of standard definition YouTube videos a second.
At the time, Professor Andreas Wicenec, director of data intensive astronomy at the International Centre for Radio Astronomy Research, said this was the first time astronomy data had been processed on this scale. Why? To check that the world's biggest radio telescope, the Square Kilometre Array (SKA), will, once built, be able to handle the deluge of astronomical data it will generate.
"We've learned a lot of lessons from the trial, including how to optimize data transfer," says Wicenec. "And completing this has told us that we can deal with the data from SKA when it comes online in the next decade. But the fact that we have needed the world's biggest supercomputer to run this test shows our needs exist at the very edge of what today's supercomputers can deliver."
https://spie.org/news/photonics-focus/mayjun-2020/square-kilometer-array-big-data?utm_id=znrastro0620e&spMailingID=5481067&spUserID=NDIwNzEwMjc3NDMS1&spJobID=1040120654&spReportId=MTA0MDEyMDY1NAS2
The Square Kilometre Array is set to be the world’s biggest radio telescope and the largest big data project in the known Universe. Will astronomers sink or swim in the digital downpour?
Late last year, an international team of researchers used the world's most powerful supercomputer—Summit—to process simulated observations of the early Universe. A mighty 400 gigabytes of data were processed every single second, equivalent to streaming more than 1,600 hours of standard definition YouTube videos a second.
At the time, Professor Andreas Wicenec, director of data intensive astronomy at the International Centre for Radio Astronomy Research, said this was the first time astronomy data had been processed on this scale. Why? To check that the world's biggest radio telescope, the Square Kilometre Array (SKA), will, once built, be able to handle the deluge of astronomical data it will generate.
"We've learned a lot of lessons from the trial, including how to optimize data transfer," says Wicenec. "And completing this has told us that we can deal with the data from SKA when it comes online in the next decade. But the fact that we have needed the world's biggest supercomputer to run this test shows our needs exist at the very edge of what today's supercomputers can deliver."
https://spie.org/news/photonics-focus/mayjun-2020/square-kilometer-array-big-data?utm_id=znrastro0620e&spMailingID=5481067&spUserID=NDIwNzEwMjc3NDMS1&spJobID=1040120654&spReportId=MTA0MDEyMDY1NAS2
Commenti
Posta un commento