REFERENCES
1. Pillonetto, G.; Aravkin, A.; Gedon, D.; Ljung, L.; Ribeiro, A. H.; Schon, T. B. Deep networks for system identification: a survey. Automatica 2025, 171, 111907.
2. Wang, Q. G.; Zhang, L. System identification in the network era: a survey of data issues and innovative approaches. IEEE/CAA. J. Autom. Sin. 2025, 12, 1305-19.
3. Fu, L.; Li, P. The research survey of system identification method. In: 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics; 2013, pp. 397-401.
5. Wang, H.; Zhang, Q.; Liu, X. Auxiliary model-based maximum likelihood multi-innovation recursive least squares identification for multiple-input multiple-output systems. J. Frankl. Inst. 2024, 361, 107352.
6. Xing, H.; Ding, F.; Zhang, X.; Luan, X.; Yang, E. Highly-efficient filtered hierarchical identification algorithms for multiple-input multiple-output systems with colored noises. Syst. Control. Lett. 2024, 186, 105762.
7. Liu, Q.; Chen, F.; Guo, Q.; Wang, X. Distributed identification based partially-coupled recursive generalized extended least squares algorithm for multivariate input-output-error systems with colored noises from observation data. J. Comput. Appl. Math. 2024, 449, 115976.
8. Wang, H.; Liu, X. Hierarchical maximum likelihood multi-innovation identification methods for a class of multivariable Hammerstein-input-nonlinear systems. J. Frankl. Inst. 2025, 362, 108143.
9. Zhou, Y.; Wu, Z.; Chen, Z.; Ma, H. Dynamic factor and multi-innovation-based output-input feedback Elman network modeling from measurements. IEEE. Trans. Instrum. Meas. 2025, 74, 1-13.
10. Qin, H.; Ji, Y. Two-stage gradient-based iterative algorithms for the Hammerstein nonlinear systems with non-uniform sampling using the key term separation. J. Frankl. Inst. 2026, 363, 108416.
11. Hjalmarsson, H. System identification of complex and structured systems. Eur. J. Control. 2009, 15, 275-310.
12. Pati, Y. C.; Rezaiifar, R.; Krishnaprasad, P. S. Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In Proceedings of 27th Asilomar Conference on Signals, Systems and Computers; 1993, pp. 40-4.
13. Tibshirani, R. Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B. Stat. Methodol. 1996, 58, 267-88.
14. Hoerl, A. E.; Kennard, R. W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 2012, 12, 55-67.
15. Zou, H.; Hastie, T. Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B. Stat. Methodol. 2005, 67, 301-20.
16. Tipping, M. E. Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 2001, 1, 211-44.
17. Tipping, M. E.; Faul, A. C. Fast marginal likelihood maximisation for sparse Bayesian models. In Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics; 2003. pp. 276-83. Available from: http://proceedings.mlr.press/r4/tipping03a.html [Last accessed on 2 Jul 2026].
18. Wipf, D.; Rao, B. D. Sparse Bayesian learning for basis selection. IEEE. Trans. Signal. Process. 2004, 52, 2153-64.
19. Ji, S.; Xue, Y.; Carin, L. Bayesian compressive sensing. IEEE. Trans. Signal. Process. 2008, 56, 2346-56.
20. Zhang, Z.; Rao, B. D. Sparse signal recovery with temporally correlated source vectors using sparse Bayesian learning. IEEE. J. Sel. Top. Signal. Process. 2011, 5, 912-26.
21. Zhang, Z.; Rao, B. D. Extension of SBL algorithms for the recovery of block sparse signals with intra-block correlation. IEEE. Trans. Signal. Process. 2013, 61, 2009-15.
22. Sant, A.; Leinonen, M.; Rao, B. D. Block-sparse signal recovery via general total variation regularized sparse Bayesian learning. IEEE. Trans. Signal. Process. 2022, 70, 1056-71.
23. Kalman, R. E. A new approach to linear filtering and prediction problems. J. Basic. Eng. 1960, 82, 35-45.
24. Welch, G.; Bishop, G. An introduction to the kalman filter. 2001. Available from: https://techreports.cs.unc.edu/papers/95-041.pdf [Last accessed on 2 Jul 2026].
25. Ljung, L. Asymptotic behavior of the extended Kalman filter as a parameter estimator for linear systems. IEEE. Trans. Automat. Contr. 1979, 24, 36-50.
26. Julier, S. J.; Uhlmann, J. K. Unscented filtering and nonlinear estimation. Proc. IEEE. 2004, 92, 401-22.
27. Loh, C. H.; Tou, I. C. A system identification approach to the detection of changes in both linear and non-linear structural parameters. Earthq. Eng. Struct. Dyn. 1995, 24, 85-97.
28. Cui, M.; Khodayar, M.; Chen, C.; Wang, X.; Zhang, Y.; Khodayar, M. E. Deep learning-based time-varying parameter identification for system-wide load modeling. IEEE. Trans. Smart. Grid. 2019, 10, 6102-14.
29. Simpkins, A. System identification: theory for the user, 2nd Edition (Ljung L., 1999) [On the Shelf]. IEEE. Robot. Automat. Mag. 2012, 19, 95-6.
30. Van Overschee, P.; De Moor, B. Subspace identification for linear systems: theory-implementation-applications. New York, NY: Springer; 2012.
31. Van Den Hof, P. M.; Schrama, R. J. Identification and control-closed-loop issues. Automatica 1995, 31, 1751-70.
32. Hjalmarsson, H.; Gevers, M.; De Bruyne, F. For model-based control design, closed-loop identification gives better performance. Automatica 1995, 32, 1659-73.
33. Feng, J.; Jia, K.; Qin, C.; Zhu, S.; Yang, X.; Tian, J. Sparse Bayesian reconstruction method for multispectral bioluminescence tomography. Chin. Opt. Lett. 2010, 8, 1010-14.
34. Bishop, C. M. Pattern recognition and machine learning. Springer; 2006. Available from: https://link.springer.com/book/9780387310732 [Last accessed on 2 Jul 2026].
36. Tropp, J. A. Greed is good: algorithmic results for sparse approximation. IEEE. Trans. Inform. Theory. 2004, 50, 2231-42.
37. Tropp, J. A.; Gilbert, A. C. Signal recovery from random measurements via orthogonal matching pursuit. IEEE. Trans. Inform. Theory. 2007, 53, 4655-66.
38. Brunton, S. L.; Proctor, J. L.; Kutz, J. N. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc. Natl. Acad. Sci. USA. 2016, 113, 3932-7.
39. Efron, B.; Hastie, T.; Johnstone, I.; Tibshirani, R. Least angle regression. Ann. Statist. 2004, 32, 407-99.
40. Friedman, J.; Hastie, T.; Tibshirani, R. Regularization paths for generalized linear models via coordinate descent. J. Stat. Soft. 2010, 33, 1-22.
42. Bickel, P. J.; Ritov, Y.; Tsybakov, A. B. Simultaneous analysis of Lasso and Dantzig selector. Ann. Statist. 2009, 37, 1705-32.
43. Rudy, S. H.; Brunton, S. L.; Proctor, J. L.; Kutz, J. N. Data-driven discovery of partial differential equations. Sci. Adv. 2017, 3, e1602614.
44. Tikhonov, A.; Tikhonov, A. N.; Tikhonov A. Solution of incorrectly formulated problems and the regularization method. Sov. Math Dok. 1963, 4, 1035-8. Available from: https://www.scienceopen.com/document?vid=aec7b578-395e-4e65-8a5a-e3b24d3f9095 [Last accessed on 2 Jul 2026].
45. Pillonetto, G.; Chen, T.; Chiuso, A.; De Nicolao, G.; Ljung, L. Regularized system identification: learning dynamic models from data. Springer; 2022.
46. Care, A.; Carli, R.; Libera, A. D.; Romeres, D.; Pillonetto, G. Kernel methods and gaussian processes for system identification and control: a road map on regularized kernel-based learning for control. IEEE. Control. Syst. Mag. 2023, 43, 69-110.
47. Widodo, A.; Kim, E. Y.; Son, J.; et al. Fault diagnosis of low speed bearing based on relevance vector machine and support vector machine. Expert. Syst. Appl. 2009, 36, 7252-61.
48. Zaman, B.; Mckee, M. Spatio-temporal prediction of root zone soil moisture using multivariate relevance vector machines. Open. J. Mod. Hydrol. 2014, 4, 80-90.
49. Bee, S.; Dervilis, N.; Worden, K.; Bull, L. Multi-task equation discovery. arXiv 2025, arXiv: 250925400.
50. Wei, Z.; Yuan, W.; Li, S.; Yuan, J.; Ng, D. W. K. Off-grid channel estimation with sparse Bayesian learning for OTFS systems. IEEE. Trans. Wireless. Commun. 2022, 21, 7407-26.
51. Wang, J.; Zhu, Q.; Lin, Z.; et al. Sparse Bayesian learning-based 3-D radio environment map construction-Sampling optimization, scenario-dependent dictionary construction, and sparse recovery. IEEE. Trans. Cogn. Commun. Netw. 2024, 10, 80-93.
52. Wang, W.; Qi, F.; Wipf, D. P.; et al. Sparse Bayesian learning for end-to-end EEG decoding. IEEE. Trans. Pattern. Anal. Mach. Intell. 2023, 45, 15632-49.
53. Wang, Q.; Dai, Y.; Ma, Z.; et al. Towards high-precision data modeling of SHM measurements using an improved sparse Bayesian learning scheme with strong generalization ability. Struct. Health. Monit. 2023, 23, 588-604.
54. Liu, B.; Zhang, Z.; Fan, H.; Fu, Q. Fast marginalized block sparse bayesian learning algorithm. arXiv 2013, arXiv: 12114909.
55. Fang, J.; Shen, Y.; Li, H.; Wang, P. Pattern-coupled sparse Bayesian learning for recovery of block-sparse signals. IEEE. Trans. Signal. Proc. 2014, 63, 360-72.
56. Tian, C.; Dong, Z.; Ji, Y.; Lin, X. Auxiliary model gradient-based iterative identification with moving data window for Wiener nonlinear output-error systems. J. Frankl. Inst. 2025, 362, 107992.
57. Ding, F.; Xiao, Y.; Xu, L.; Fang, Z. Hierarchical stochastic gradient and hierarchical multi-innovation stochastic gradient identification for multivariable ARX models. Int. J. Adapt. Control. Signal. Process. 2025, 40, 79-102.
58. Ding, F.; Luan, X.; Xu, L.; Zhang, X. Hierarchical recursive gradient parameter identification for multi-input ARX systems with partially-coupled information vectors. Int. J. Adapt. Control. Signal. Process. 2025, 39, 1978-95.
59. Xu, L.; Ding, F.; Zhang, X.; Zhu, Q. Novel parameter estimation method for the systems with colored noises by using the filtering identification idea. Syst. Control. Lett. 2024, 186, 105774.
60. Ding, F.; Xu, L.; Zhang, X.; Xu, H.; Zhou, Y.; Luan, X. Hierarchical generalized extended parameter identification for multivariable equation-error ARMA-like systems by using the filtering identification idea. Ann. Rev. Control. 2025, 60, 100993.
62. Genc, S. Parametric system identification using deep convolutional neural networks. In 2017 International Joint Conference on Neural Networks (IJCNN); 2017. pp. 2112-9.
63. Wu, R.; Jahanshahi, M. R. Deep convolutional neural network for structural dynamic response estimation and system identification. J. Eng. Mech. 2019, 145, 04018125.
64. Wang, Y. A new concept using LSTM Neural Networks for dynamic system identification. In 2017 American control conference (ACC); 2017. pp. 5324-29.
65. Brusaferri, A.; Matteucci, M.; Portolani, P.; Spinelli, S. Nonlinear system identification using a recurrent network in a Bayesian framework. In 2019 IEEE 17th international conference on industrial informatics (INDIN); 2019, pp. 319-24.
66. Wang, H.; Luo, C.; Wang, X. Synchronization and identification of nonlinear systems by using a novel self-evolving interval type-2 fuzzy LSTM-neural network. Eng. Appl. Artif. Intell. 2019, 81, 79-93.
67. Alshathri, K.; Xia, H.; Lawrence, V.; Yao, Y. Cellular system identification using deep learning: GSM, UMTS and LTE. In 2019 28th Wireless and Optical Communications Conference (WOCC); 2019, pp. 1-4.
68. Forgione, M.; Piga, D. Model structures and fitting criteria for system identification with neural networks. In 2020 IEEE 14th International Conference on Application of Information and Communication Technologies (AICT); 2020, pp. 1-6.
69. Sahu, I.; Pal, A.; Ukil, A.; Majumdar, A. Compressing deep neural network: a black-box system identification approach. In 2021 International Joint Conference on Neural Networks (IJCNN); 2021, pp. 1-8.
70. Mangan, N. M.; Kutz, J. N.; Brunton, S. L.; Proctor, J. L. Model selection for dynamical systems via sparse regression and information criteria. Proc. R. Soc. A. Math. Phys. Eng. Sci. 2017, 473, 20170009.
71. Schaeffer, H.; Mccalla, S. G. Sparse model selection via integral terms. Phys. Rev. E. 2017, 96, 023302.
72. Fasel, U.; Kutz, J. N.; Brunton, B. W.; Brunton, S. L. Ensemble-SINDy: robust sparse model discovery in the low-data, high-noise limit, with active learning and control. Proc. R. Soc. A. 2022, 478, 20210904.
73. Messenger, D. A.; Bortz, D. M. Weak SINDy for partial differential equations. J. Comput. Phys. 2021, 443, 110525.
74. Xu, H.; Chang, H.; Zhang, D. DLGA-PDE: discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm. J. Comput. Phys. 2020, 418, 109584.
75. Chen, Y.; Luo, Y.; Liu, Q.; Xu, H.; Zhang, D. Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE). Phys. Rev. Res. 2022, 4, 023174.
76. Zhang, X.; Guan, J.; Liu, Y.; Wang, G. MORL4PDEs: data-driven discovery of PDEs based on multi-objective optimization and reinforcement learning. Chaos. Soliton. Fract. 2024, 180, 114536.
77. Both, G.; Choudhury, S.; Sens, P.; Kusters, R. DeepMoD: deep learning for model discovery in noisy data. J. Comput. Phys. 2021, 428, 109985.
78. Chen, Z.; Liu, Y.; Sun, H. Physics-informed learning of governing equations from scarce data. Nat. Commun. 2021, 12, 6136.
79. Stephany, R.; Earls, C. PDE-LEARN: using deep learning to discover partial differential equations from noisy, limited data. Neural. Netw. 2024, 174, 106242.
80. Pervez, A.; Gavves, E.; Locatello, F. Mechanistic PDE networks for discovery of governing equations. In Forty-second International Conference on Machine Learning; 2025. Available from: https://openreview.net/forum?id=7w1YGBPDMw [Last accessed on 2 Jul 2026].
81. Timme, M.; Casadiego, J. Revealing networks from dynamics: an introduction. J. Phys. A. Math. Theor. 2014, 47, 343001.
82. Han, X.; Shen, Z.; Wang, W.; Lai, Y.; Grebogi, C. Reconstructing direct and indirect interactions in networked public goods game. Sci. Rep. 2016, 6, 30241.
83. Yuan, Y.; Tang, X.; Zhou, W.; et al. Data driven discovery of cyber physical systems. Nat. Commun. 2019, 10, 4894.
84. Kaiser, E.; Kutz, J. N.; Brunton, S. L. Sparse identification of nonlinear dynamics for model predictive control in the low-data limit. Proc. R. Soc. A. 2018, 474, 20180305.
85. Deng, N.; Noack, B. R.; Morzyński, M.; Pastur, L. R. Galerkin force model for transient and post-transient dynamics of the fluidic pinball. J. Fluid. Mech. 2021, 918, A4.
86. Kaptanoglu, A. A.; Morgan, K. D.; Hansen, C. J.; Brunton, S. L. Physics-constrained, low-dimensional models for magnetohydrodynamics: first-principles and data-driven approaches. Phys. Rev. E. 2021, 104, 015206.
87. Sorokina, M.; Sygletos, S.; Turitsyn, S. Sparse identification for nonlinear optical communication systems: SINO method. Opt. Express. 2016, 24, 30433-43.
88. Boninsegna, L.; Nüske, F.; Clementi, C. Sparse learning of stochastic dynamical equations. J. Chem. Phys. 2018, 148, 241723.
89. Finn, C.; Abbeel, P.; Levine, S. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning; 2017, pp. 1126-35. Available from: https://proceedings.mlr.press/v70/finn17a.html [Last accessed on 2 Jul 2026].
90. Lin, S.; Wang, H.; Zhang, J. System identification via meta-learning in linear time-varying environments. arXiv 2020, arXiv: 201014664.
91. Iwata, T.; Kawahara, Y. Meta-learning for koopman spectral analysis with short time-series. arXiv 2021, arXiv: 210204683.
92. Grant, E.; Finn, C.; Levine, S.; Darrell, T.; Griffiths, T. Recasting gradient-based meta-learning as hierarchical bayes. arXiv 2018, arXiv: 180108930.
93. Shojaee, P.; Meidani, K.; Gupta, S.; Farimani, A. B.; Reddy, C. K.; LLM-SR: scientific equation discovery via programming with large language models. In The Thirteenth International Conference on Learning Representations; 2025. Available from: https://openreview.net/forum?id=m2nmp8P5in [Last accessed on 2 Jul 2026].
94. Merler, M.; Haitsiukevich, K.; Dainese, N.; Marttinen, P. In-context symbolic regression: Leveraging large language models for function discovery. arXiv 2024, arXiv: 240419094.
95. Li, M. Y.; Fox, E. B.; Goodman, N. D. Automated statistical model discovery with language models. arXiv 2024, arXiv: 240217879.
96. Du, M.; Chen, Y.; Wang, Z.; Nie, L.; Zhang, D. Llm4ed: large language models for automatic equation discovery. arXiv 2024, arXiv: 240507761.
97. Grayeli, A.; Sehgal, A.; Costilla-Reyes, O.; Cranmer, M.; Chaudhuri, S. Symbolic regression with a learned concept library. Adv. Neural. Inf. Proc. Syst. 2024, 37, 44678-709.
98. Guo, P.; Zhang, Q.; Lin, X. Coevo: continual evolution of symbolic solutions using large language models. arXiv 2024, arXiv: 241218890.
99. Zhang, Y.; Zheng, K.; Liu, F.; Zhang, Q.; Wang, Z. AutoTurb: using large language models for automatic algebraic turbulence model discovery. Phys. Fluids. 2025, 37, 015211.
100. Zhang, R.; Liu, F.; Lin, X.; Wang, Z.; Lu, Z.; Zhang, Q. Understanding the importance of evolutionary search in automated heuristic design with large language models. In International Conference on Parallel Problem Solving from Nature; 2024, pp. 185-202.
101. Wang, R.; Wang, B.; Li, K.; Zhang, Y.; Cheng, J. DrSR: LLM based scientific equation discovery with dual reasoning from data and experience. arXiv 2025, arXiv: 250604282.
102. Liu, J.; Lai, S.; Li, P.; et al. Mimicking the physicist's eye: a VLM-centric approach for physics formula discovery. arXiv 2025, arXiv: 250817380.
103. Ma, P.; Wang, T. H.; Guo, M.; et al. LLM and simulation as bilevel optimizers: a new paradigm to advance physical scientific discovery. arXiv 2024, arXiv: 240509783.
104. Shojaee, P.; Nguyen, N. H.; Meidani, K.; Barati Farimani, A.; Doan, K. D.; Reddy, C. K. LLM-SRBench: a new benchmark for scientific equation discovery with large language models. In Proceedings of the 42nd International Conference on Machine Learning, Vancouver, Canada; 2025, pp. 55325-59. https://doi.org/10.48550/arXiv.2504.10415.
105. Chen, Y.; Piekos, P.; Ostaszewski, M.; Laakom, F.; Schmidhuber, J. PhysGym: benchmarking LLMs in interactive physics discovery with controlled priors. arXiv 2025, arXiv: 250715550.
106. Abhyankar, N.; Shojaee, P.; Reddy, C. K. LLM-FE: automated feature engineering for tabular data with LLMs as evolutionary optimizers. arXiv 2025, arXiv: 250314434.
107. Holt, S.; Qian, Z.; Liu, T.; Weatherall, J.; van der Schaar, M. Data-driven discovery of dynamical systems in pharmacology using large language models. Adv. Neural. Inf. Process. Syst. 2024, 37, 96325-66.
108. Spillias, S.; Rogers, J.; Boschetti, F.; et al. Data-driven discovery of mechanistic ecosystem models with LLMs. bioRxiv 2025, 2025, 2025-7.
109. Kramer, S.; Cerrato, M.; Brugger, J.; Džeroski, S.; King, R. D. Automated scientific discovery: from equation discovery to autonomous discovery systems. Mach. Learn. 2026, 115, 109.
110. Taskin, B.; Xie, W.; Lazebnik, T. Knowledge integration for physics-informed symbolic regression using pre-trained large language models. Sci. Rep. 2026, 16, 1614.
111. Yang, J.; Venkatachalam, O.; Kianezhad, M.; Vadgama, S.; Yu, R. Think like a scientist: physics-guided LLM agent for equation discovery. arXiv 2026, arXiv: 2602.12259.
