Discovering key users in Chinese social networks based on dynamic web crawlers

Wang Qiu; Siti Norbaya Daud

doi:10.1117/12.3031324

19 July 2024 Discovering key users in Chinese social networks based on dynamic web crawlers

Wang Qiu, Siti Norbaya Daud

Proceedings Volume 13181, Third International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024); 131816W (2024) https://doi.org/10.1117/12.3031324
Event: Third International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024), 2024, Beijing, China

Abstract

Weibo, which has over 100 million users, stands as one of China's foremost social media platforms. Among these users, key individuals have become the focal point of numerous studies. However, identifying these key users amid the vast social network presents a formidable challenge. While web crawlers serve as ubiquitous tools for harvesting internet data, the complexity of social network data mining demands specialized algorithms. This paper delves into the analysis of Weibo's webpage structure and content-pushing rules, presenting a method for the discovery of key users utilizing a web crawler. Implementing a web crawler program, developed using Python and Selenium, underscores the practicality of the proposed approach. The results of the experiments validate the effectiveness of the method in extracting data from key users, thereby establishing a database for further research in this domain.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Wang Qiu and Siti Norbaya Daud "Discovering key users in Chinese social networks based on dynamic web crawlers", Proc. SPIE 13181, Third International Conference on Electronic Information Engineering, Big Data, and Computer Technology (EIBDCT 2024), 131816W (19 July 2024); https://doi.org/10.1117/12.3031324

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available