The Application of Natural Language Processing Technology in the Era of Big Data

Hao Yan; Jingxuan Xiao; Beibei Zhang; Liziqiu Yang; Ping Qu

doi:10.5281/zenodo.11399706

Authors

Hao Yan Syracuse University
Jingxuan Xiao Georgia Institution of Technology
Beibei Zhang Xi'an Jiaotong University
Liziqiu Yang University of Illinois-Urbana Champaign
Ping Qu Maharishi International University

DOI:

https://doi.org/10.5281/zenodo.11399706

Keywords:

Natural Language Processing, Text Classification, Information Extraction, Question and Answer System, Machine Translation

Abstract

Natural language processing technology plays an important role in the era of big data, provides a powerful support for data mining and information retrieval, this paper discusses the application of natural language processing technology in the big data environment, analyzes the text classification, information extraction, answer system and the application prospect of machine translation, and expounds the related technology in improving the efficiency and quality of data processing advantages, the research shows that natural language processing technology brings new opportunities for big data analysis, laid a foundation for realizing more intelligent data utilization.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Author Biographies

Hao Yan, Syracuse University

Engineering and Computer Science, Syracuse University, Syracuse, NY, USA.

Jingxuan Xiao, Georgia Institution of Technology

Computer Science, Georgia Institution of Technology, Atlanta, GA, USA.

Beibei Zhang, Xi'an Jiaotong University

Software Engineering, Xi'an Jiaotong University, Xi'an, China.

Liziqiu Yang, University of Illinois-Urbana Champaign

Statistics and Computer Science, University of Illinois-Urbana Champaign, Champaign, IL, USA.

Ping Qu, Maharishi International University

Computer Science, Maharishi International University, Fairfield, IA, USA.

References

Yi, Xinyao, and Yuxin Qiao. "GPU-Based Parallel Computing Methods for Medical Photoacoustic Image Reconstruction." arXiv preprint arXiv:2404.10928 (2024).

Liu, Tianrui, et al. "Particle Filter SLAM for Vehicle Localization." arXiv preprint arXiv:2402.07429 (2024).

Ma, Danqing, et al. "Fostc3net: A Lightweight YOLOv5 Based On the Network Structure Optimization." arXiv preprint arXiv:2403.13703 (2024).

Zang, Hengyi. "Precision calibration of industrial 3d scanners: An ai-enhanced approach for improved measurement accuracy." Global Academic Frontiers 2.1 (2024): 27-37.

Yao, Jiawei, et al. "Ndc-scene: Boost monocular 3d semantic scene completion in normalized device coordinates space." 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE Computer Society, 2023.

Zhang, Ye, et al. "Deepgi: An automated approach for gastrointestinal tract segmentation in mri scans." arXiv preprint arXiv:2401.15354 (2024).

Zou, Zhibin, et al. "Joint spatio-temporal precoding for practical non-stationary wireless channels." IEEE Transactions on Communications 71.4 (2023): 2396-2409.

Cao, Jin, et al. "A Structurally Enhanced, Ergonomically and Human–Computer Interaction Improved Intelligent Seat’s System." Designs 1.2 (2017): 11.

Lin, Tinglan, and Jin Cao. "Touch Interactive System Design with Intelligent Vase of Psychotherapy for Alzheimer’s Disease." Designs 4.3 (2020): 28.

Li, Keqin, et al. "The application of augmented reality (ar) in remote work and education." arXiv preprint arXiv:2404.10579 (2024).

Guo, Fusen. "A Study of Smart Grid Program Optimization Based on K-Mean Algorithm." 2023 3rd International Conference on Electrical Engineering and Mechatronics Technology (ICEEMT). IEEE, 2023.

Zou, Zhibin, et al. "Unified characterization and precoding for non-stationary channels." ICC 2022-IEEE International Conference on Communications. IEEE, 2022.

Nagao, Masahiro, et al. "An efficient deep learning-based workflow for CO2 plume imaging considering model uncertainties with distributed pressure and temperature measurements." International Journal of Greenhouse Gas Control 132 (2024): 104066.

Yao, Changqing, Masahiro Nagao, and Akhil Datta-Gupta. A Deep-Learning Based Accelerated Workflow for Robust CO2 Plume Imaging at the Illinois Basin-Decatur Carbon Sequestration Project. National Energy Technology Laboratory (NETL), Pittsburgh, PA, Morgantown, WV, and Albany, OR (United States), 2023.

Song, Jintong, et al. "A comprehensive evaluation and comparison of enhanced learning methods." Academic Journal of Science and Technology 10.3 (2024): 167-171.

Liu, Tianrui, et al. "News recommendation with attention mechanism." arXiv preprint arXiv:2402.07422 (2024).

Li K, Zhu A, Zhou W, et al. Utilizing deep learning to optimize software development processes[J]. arXiv preprint arXiv:2404.13630, 2024.

Peng, Qucheng. Multi-source and Source-Private Cross-Domain Learning for Visual Recognition. Diss. Purdue University, 2022.

Su, Jing, et al. "Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Review." arXiv preprint arXiv:2402.10350 (2024).

Liu, Shun, et al. "Financial time-series forecasting: Towards synergizing performance and interpretability within a hybrid machine learning approach." arXiv preprint arXiv:2401.00534 (2023).

Feng, Mingyang, et al. "Enhanced Heart Attack Prediction Using eXtreme Gradient Boosting." Journal of Theory and Practice of Engineering Science 4.04 (2024): 9-16.

Li, Shaojie, et al. "Utilizing the LightGBM Algorithm for Operator User Credit Assessment Research." arXiv preprint arXiv:2403.14483 (2024).

Ni, Fanghao, Hengyi Zang, and Yuxin Qiao. "Smartfix: Leveraging machine learning for proactive equipment maintenance in industry 4.0." The 2nd International scientific and practical conference “Innovations in education: prospects and challenges of today”(January 16-19, 2024) Sofia, Bulgaria. International Science Group. 2024. 389 p.. 2024.

Zhang, Ye, et al. "Development and application of a monte carlo tree search algorithm for simulating da vinci code game strategies." arXiv preprint arXiv:2403.10720 (2024).

Zhu, Mengran, et al. "Ensemble Methodology: Innovations in Credit Default Prediction Using LightGBM, XGBoost, and LocalEnsemble." arXiv preprint arXiv:2402.17979 (2024).

Guo, Fusen, Jian-Zhang Wu, and Lei Pan. "An Empirical Study of AI Model’s Performance for Electricity Load Forecasting with Extreme Weather Conditions." International Conference on Science of Cyber Security. Cham: Springer Nature Switzerland, 2023.

Liu, Tianrui, et al. "Rumor Detection with a novel graph neural network approach." arXiv preprint arXiv:2403.16206 (2024).

Peng, Qucheng, et al. "RAIN: regularization on input and network for black-box domain adaptation." arXiv preprint arXiv:2208.10531 (2022).

Peng, Qucheng, Ce Zheng, and Chen Chen. "Source-free domain adaptive human pose estimation." Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023.

Jin, Jiajun, et al. "Enhancing federated semi-supervised learning with out-of-distribution filtering amidst class mismatches." Journal of Computer Technology and Applied Mathematics 1.1 (2024): 100-108.

Zhu, Armando, et al. "Cross-task multi-branch vision transformer for facial expression and mask wearing classification." arXiv preprint arXiv:2404.14606 (2024).

Zhang, Ning, et al. "Dose My Opinion Count? A CNN-LSTM Approach for Sentiment Analysis of Indian General Elections." Journal of Theory and Practice of Engineering Science 4.05 (2024): 40-50.

Xiong, Jize, et al. "Decoding sentiments: Enhancing covid-19 tweet analysis through bert-rcnn fusion." Journal of Theory and Practice of Engineering Science 4.01 (2024): 86-93.

Li, Shaojie, et al. "Leveraging deep learning and xception architecture for high-accuracy mri classification in alzheimer diagnosis." arXiv preprint arXiv:2403.16212 (2024).

Yao, Jiawei, Tong Wu, and Xiaofeng Zhang. "Improving depth gradient continuity in transformers: A comparative study on monocular depth estimation with cnn." arXiv preprint arXiv:2308.08333 (2023).

Xu, Changxin, et al. "Deep learning in photovoltaic power generation forecasting: Cnn-lstm hybrid neural network exploration and research." The 3rd International scientific and practical conference “Technologies in education in schools and universities”(January 23-26, 2024) Athens, Greece. International Science Group. 2024. 363 p.. 2024.

Wang, Xiaosong, et al. "Advanced network intrusion detection with tabtransformer." Journal of Theory and Practice of Engineering Science 4.03 (2024): 191-198.

Liu, Tianrui, et al. "Image Captioning in news report scenario." arXiv preprint arXiv:2403.16209 (2024).

Zhao, Zhiming, et al. "Enhancing E-commerce Recommendations: Unveiling Insights from Customer Reviews with BERTFusionDNN." Journal of Theory and Practice of Engineering Science 4.02 (2024): 38-44.

Yao, Jiawei, et al. "Building lane-level maps from aerial images." ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2024.

Zhibin, Z. O. U., S. O. N. G. Liping, and Cheng Xuan. "Labeled box-particle CPHD filter for multiple extended targets tracking." Journal of Systems Engineering and Electronics 30.1 (2019): 57-67.

Zou, Zhi-bin, Li-ping Song, and Zhi-long Song. "Labeled box-particle PHD filter for multi-target tracking." 2017 3rd IEEE International Conference on Computer and Communications (ICCC). IEEE, 2017.

Sun, Yiping, et al. "Relation classification using coarse and fine-grained networks with SDP supervised key words selection." Knowledge Science, Engineering and Management: 11th International Conference, KSEM 2018, Changchun, China, August 17–19, 2018, Proceedings, Part I 11. Springer International Publishing, 2018.

Jiang, Haowei, et al. "Recurrent neural network from adder’s perspective: Carry-lookahead RNN." Neural Networks 144 (2021): 297-306.

Zhang, Ye, et al. "Unlocking Personalized Anime Recommendations: Langchain and LLM at the Forefront." Journal of Industrial Engineering and Applied Science 2.2 (2024): 46-53.

Zhang, Ye, et al. "Optimizing science question ranking through model and retrieval-augmented generation." International Journal of Computer Science and Information Technology 1.1 (2023): 124-130.

Li, Huan, Feng Xu, and Zheng Lin. "ET-DM: Text to image via diffusion model with efficient Transformer." Displays 80 (2023): 102568.

Wang, Jin, et al. "Research on emotionally intelligent dialogue generation based on automatic dialogue system." arXiv preprint arXiv:2404.11447 (2024).

Zang, Hengyi, et al. "Evaluating the social impact of ai in manufacturing: A methodological framework for ethical production." Academic Journal of Sociology and Management 2.1 (2024): 21-25.