Deploying the Big Data Science Center at the Shanghai Synchrotron Radiation Facility: the first superfacility platform in China

Wang, Chunpeng and Yu, Feng and Liu, Yiyang and Li, Xiaoyun and Chen, Jige and Thiyagalingam, Jeyan and Sepe, Alessandro (2021) Deploying the Big Data Science Center at the Shanghai Synchrotron Radiation Facility: the first superfacility platform in China. Machine Learning: Science and Technology, 2 (3). 035003. ISSN 2632-2153

[thumbnail of Wang_2021_Mach._Learn.__Sci._Technol._2_035003.pdf] Text
Wang_2021_Mach._Learn.__Sci._Technol._2_035003.pdf - Published Version

Download (4MB)

Abstract

With recent technological advances, large-scale experimental facilities generate huge datasets, into the petabyte range, every year, thereby creating the Big Data deluge effect. Data management, including the collection, management, and curation of these large datasets, is a significantly intensive precursor step in relation to the data analysis that underpins scientific investigations. The rise of artificial intelligence (AI), machine learning (ML), and robotic automation has changed the landscape for experimental facilities, producing a paradigm shift in how different datasets are leveraged for improved intelligence, operation, and data analysis. Therefore, such facilities, known as superfacilities, which fully enable user science while addressing the challenges of the Big Data deluge, are critical for the scientific community. In this work, we discuss the process of setting up the Big Data Science Center within the Shanghai Synchrotron Radiation Facility (SSRF), China's first superfacility. We provide details of our initiatives for enabling user science at SSRF, with particular consideration given to recent developments in AI, ML, and robotic automation.

Item Type: Article
Subjects: OA Digital Library > Multidisciplinary
Depositing User: Unnamed user with email support@oadigitallib.org
Date Deposited: 06 Jul 2023 04:10
Last Modified: 04 Jun 2024 11:08
URI: http://library.thepustakas.com/id/eprint/1670

Actions (login required)

View Item
View Item