{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,29]],"date-time":"2026-08-29T16:00:11Z","timestamp":1788019211403,"version":"build-2784847793"},"reference-count":113,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2020,9,28]],"date-time":"2020-09-28T00:00:00Z","timestamp":1601251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"crossref","award":["61876206"],"award-info":[{"award-number":["61876206"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Program of China","award":["2016YFB1000901"],"award-info":[{"award-number":["2016YFB1000901"]}]},{"name":"Australian Research Council Discovery Projects","award":["DP170101306"],"award-info":[{"award-number":["DP170101306"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2021,9,30]]},"abstract":"<jats:p>Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt to capture causal relationships between them. It has been shown that the knowledge about the causal relationships between features and the class variable has potential benefits for building interpretable and robust prediction models, since causal relationships imply the underlying mechanism of a system. Consequently, causality-based feature selection has gradually attracted greater attentions and many algorithms have been proposed. In this article, we present a comprehensive review of recent advances in causality-based feature selection. To facilitate the development of new algorithms in the research area and make it easy for the comparisons between new methods and existing ones, we develop the first open-source package, called CausalFS, which consists of most of the representative causality-based feature selection algorithms (available at https:\/\/github.com\/kuiy\/CausalFS). Using CausalFS, we conduct extensive experiments to compare the representative algorithms with both synthetic and real-world datasets. Finally, we discuss some challenging problems to be tackled in future research.<\/jats:p>","DOI":"10.1145\/3409382","type":"journal-article","created":{"date-parts":[[2020,9,28]],"date-time":"2020-09-28T06:45:25Z","timestamp":1601275525000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":193,"title":["Causality-based Feature Selection"],"prefix":"10.1145","volume":"53","author":[{"given":"Kui","family":"Yu","sequence":"first","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xianjie","family":"Guo","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Liu","sequence":"additional","affiliation":[{"name":"University of South Australia, Adelaide, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiuyong","family":"Li","sequence":"additional","affiliation":[{"name":"University of South Australia, Adelaide, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Wang","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaolong","family":"Ling","sequence":"additional","affiliation":[{"name":"Hefei University of Technology, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xindong","family":"Wu","sequence":"additional","affiliation":[{"name":"Mininglamp Technology, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,9,28]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-005-0473-4"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-011-0247-5"},{"key":"e_1_2_2_3_1","volume-title":"Categorical Data Analysis","author":"Agresti Alan"},{"key":"e_1_2_2_4_1","volume-title":"Selected Papers of Hirotugu Akaike","author":"Akaike Hirotugu"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1756013"},{"key":"e_1_2_2_6_1","first-page":"235","article-title":"Local causal and markov blanket induction for causal discovery and feature selection for classification part ii: Analysis and extensions","author":"Aliferis Constantin F.","year":"2010","journal-title":"J. Mach. Learn. Res. 11"},{"key":"e_1_2_2_7_1","volume-title":"AMIA Annual Symposium Proceedings","volume":"2003","author":"Aliferis Constantin F.","year":"2003"},{"key":"e_1_2_2_8_1","volume-title":"Invariant risk minimization. Arxiv Preprint Arxiv:1907.02893","author":"Arjovsky Martin","year":"2019"},{"key":"e_1_2_2_9_1","volume-title":"Beyond prediction: Using big data for policy problems. Science 355, 6324","author":"Athey Susan","year":"2017"},{"key":"e_1_2_2_10_1","first-page":"1","article-title":"Learning Bayesian networks from correlated data. Sci","volume":"6","author":"Bae Harold","year":"2016","journal-title":"Rep."},{"key":"e_1_2_2_11_1","volume-title":"A meta-transfer objective for learning to disentangle causal mechanisms. Arxiv Preprint:1901.10912","author":"Bengio Yoshua","year":"2019"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3322706.3322714"},{"key":"e_1_2_2_13_1","first-page":"27","article-title":"Conditional likelihood maximisation: A unifying framework for information theoretic feature selection","author":"Brown Gavin","year":"2012","journal-title":"J. Mach. Learn. Res. 13"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-203-8.50010-3"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2010.10.023"},{"key":"e_1_2_2_16_1","first-page":"2149","article-title":"A scoring function for learning Bayesian networks based on mutual information and conditional independence tests","author":"de Campos Luis M.","year":"2006","journal-title":"J. Mach. Learn. Res. 7"},{"key":"e_1_2_2_17_1","volume-title":"Causal query in observational data with hidden variables. Arxiv Preprint:2001.10269","author":"Cheng Debo","year":"2020"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244302760200696"},{"key":"e_1_2_2_19_1","first-page":"507","article-title":"Optimal structure identification with greedy search","author":"Chickering David Maxwell","year":"2002","journal-title":"J. Mach. Learn. Res. 3"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1214\/11-AOS940"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994110"},{"key":"e_1_2_2_22_1","volume-title":"Inferring deterministic causal relations. Arxiv Preprint Arxiv:1203.3475","author":"Daniusis Povilas","year":"2012"},{"key":"e_1_2_2_23_1","volume-title":"Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD\u201908)","author":"De Morais Sergio Rodrigues","year":"2008"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214508000000193"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1214\/17-AOS1631"},{"key":"e_1_2_2_26_1","volume-title":"Desmarais","author":"Fu Shunkai","year":"2008"},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201917)","author":"Gao Tian","year":"2017"},{"key":"e_1_2_2_28_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201915)","author":"Gao Tian","year":"2015"},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI\u201916)","author":"Gao Tian","year":"2016"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2016.2539338"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2016.09.009"},{"key":"e_1_2_2_32_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201918)","author":"Gao Tian","year":"2018"},{"key":"e_1_2_2_33_1","volume-title":"Review of causal discovery methods based on graphical models. Front. Genet. 10","author":"Glymour Clark","year":"2019"},{"key":"e_1_2_2_34_1","volume-title":"Causal generative neural networks. Arxiv Preprint:1711.08936","author":"Goudet Olivier","year":"2017"},{"key":"e_1_2_2_35_1","first-page":"1","article-title":"A survey of learning causality with data: Problems and methods","volume":"53","author":"Guo Ruocheng","year":"2020","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_2_2_36_1","volume-title":"et\u00a0al","author":"Guyon Isabelle","year":"2007"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/944919.944968"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022623210503"},{"key":"e_1_2_2_39_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems. 689--696","author":"Hoyer Patrik O.","year":"2009"},{"key":"e_1_2_2_40_1","volume-title":"Proceedings of the Uncertainty in Artificial Intelligence Conference (UAI\u201915)","author":"Hyttinen Antti","year":"2015"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.01.002"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v047.i11"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00043-X"},{"key":"e_1_2_2_44_1","first-page":"549","article-title":"Exact Bayesian structure discovery in Bayesian networks","author":"Koivisto Mikko","year":"2004","journal-title":"J. Mach. Learn. Res. 5"},{"key":"e_1_2_2_45_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201996)","author":"Koller Daphne","year":"1996"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.1994.tb00166.x"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136625"},{"key":"e_1_2_2_48_1","volume-title":"Practical Approaches to Causal Relationship Exploration","author":"Li Jiuyong"},{"key":"e_1_2_2_49_1","article-title":"Using feature selection for local causal structure learning","volume":"10","author":"Ling Zhaolong","year":"2020","journal-title":"IEEE Trans. Emerg. Topics Comput. Intell. DOI"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3335676"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-016-5545-0"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/3291125.3309605"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOS685"},{"key":"e_1_2_2_54_1","volume-title":"Proceedings of the Conference and Workshop on Neural Information Processing Systems (NeurIPS\u201918)","author":"Magliacane Sara"},{"key":"e_1_2_2_55_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201909)","author":"Margaritis Dimitris","year":"2009"},{"key":"e_1_2_2_56_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems (NIPS\u201900)","author":"Margaritis Dimitris","year":"2000"},{"key":"e_1_2_2_57_1","volume-title":"Masegosa and Seraf\u00edn Moral","author":"Andr\u00e9s","year":"2012"},{"key":"e_1_2_2_58_1","volume-title":"Handbook of Biological Statistics","author":"McDonald John H."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.2946677"},{"key":"e_1_2_2_60_1","first-page":"1024","article-title":"The Bayes net toolbox for","volume":"33","author":"\u00a0al Kevin Murphy","year":"2001","journal-title":"Matlab. Comput. Sci. Statist."},{"key":"e_1_2_2_61_1","volume-title":"Proceedings of the Workshop on Causal Structure Learning of UAI\u201912","author":"Niinimki T.","year":"2012"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/82.4.669"},{"key":"e_1_2_2_63_1","volume-title":"Cambridge University Press","author":"Pearl Judea"},{"key":"e_1_2_2_64_1","unstructured":"Judea Pearl. 2014. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann.  Judea Pearl. 2014. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann."},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-SS057"},{"key":"e_1_2_2_66_1","volume-title":"The Book of Why: the New Science of Cause and Effect","author":"Pearl Judea"},{"key":"e_1_2_2_67_1","first-page":"1295","article-title":"Using Markov blankets for causal structure learning","author":"Pellet Jean-Philippe","year":"2008","journal-title":"J. Mach. Learn. Res. 9"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792674.1792689"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/11518655_13"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2006.06.008"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1111\/rssb.12167"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.71"},{"key":"e_1_2_2_73_1","volume-title":"Elements of Causal Inference: Foundations and Learning Algorithms","author":"Peters Jonas"},{"key":"e_1_2_2_74_1","volume-title":"Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence. 589--598","author":"Peters Jonas","year":"2011"},{"key":"e_1_2_2_75_1","volume-title":"Proceedings of the International Workshop on Artificial Intelligence and Statistics (AI and Statistics\u201912)","author":"Pocock Adam","year":"2012"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41060-016-0032-z"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1031689015"},{"key":"e_1_2_2_78_1","volume-title":"Proceedings of the Conference and Workshop on Neural Information Processing Systems (NeurIPS\u201918)","author":"Rohekar Raanan Y.","year":"2018"},{"key":"e_1_2_2_79_1","first-page":"1","article-title":"Invariant models for causal transfer learning","volume":"19","author":"Rojas-Carulla M.","year":"2018","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_2_80_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btm344"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327906mbr3301_3"},{"key":"e_1_2_2_82_1","volume-title":"Causality for machine learning. Arxiv Preprint:1911.10500","author":"Sch\u00f6lkopf Bernhard","year":"2019"},{"key":"e_1_2_2_83_1","volume-title":"Learning Bayesian networks with the bnlearn R package. Arxiv Preprint:0908.3817","author":"Scutari Marco","year":"2009"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23528-8_22"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-017-5648-2"},{"key":"e_1_2_2_86_1","first-page":"2003","article-title":"A linear non-Gaussian acyclic model for causal discovery","author":"Shimizu Shohei","year":"2006","journal-title":"J. Mach. Learn. Res. 7"},{"key":"e_1_2_2_87_1","volume-title":"Prediction, and Search","author":"Spirtes Peter"},{"key":"e_1_2_2_88_1","first-page":"499","article-title":"Algorithms for discovery of multiple Markov boundaries","author":"Statnikov Alexander","year":"2013","journal-title":"J. Mach. Learn. Res. 14"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2912102"},{"key":"e_1_2_2_90_1","first-page":"267","article-title":"Causal explorer: A Matlab library of algorithms for causal discovery and variable selection for classification","volume":"2","author":"Statnikov Alexander","year":"2010","journal-title":"Chall. Mach. Learn."},{"key":"e_1_2_2_91_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201919)","author":"Suter Raphael","year":"2019"},{"key":"e_1_2_2_92_1","volume-title":"Proceedings of the 9th International Workshop on Artificial Intelligence and Statistics. Citeseer.","author":"Tsamardinos Ioannis","year":"2003"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/956750.956838"},{"key":"e_1_2_2_94_1","volume-title":"Proceedings of the Florida Artificial Intelligence Research Society Conference (FLAIRS\u201903)","volume":"2","author":"Tsamardinos Ioannis","year":"2003"},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-018-5748-7"},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-6889-7"},{"key":"e_1_2_2_97_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2014.03.003"},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.collaboratecom.2012.250689"},{"key":"e_1_2_2_99_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2019.09.010"},{"key":"e_1_2_2_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2019.2940509"},{"key":"e_1_2_2_101_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.197"},{"key":"e_1_2_2_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2005.134"},{"key":"e_1_2_2_103_1","volume-title":"Proceedings of the Workshop on the Causation and Prediction Challenge. 93--105","author":"Yin Jianxin","year":"2008"},{"key":"e_1_2_2_104_1","volume-title":"Discovering Markov blanket from multiple interventional datasets. Arxiv Preprint:1801.08295","author":"Yu Kui","year":"2018"},{"key":"e_1_2_2_105_1","volume-title":"A unified view of causal and non-causal feature selection. Arxiv Preprint:1802.05844","author":"Yu Kui","year":"2018"},{"key":"e_1_2_2_106_1","first-page":"1","article-title":"Mining Markov blankets without causal sufficiency","volume":"99","author":"Yu Kui","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"e_1_2_2_107_1","article-title":"Multi-source causal feature selection","volume":"10","author":"Yu Kui","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell. DOI"},{"key":"e_1_2_2_108_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2602365"},{"key":"e_1_2_2_109_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML\u201919)","author":"Yu Yue","year":"2019"},{"key":"e_1_2_2_110_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2014.2326099"},{"key":"e_1_2_2_111_1","volume-title":"Kernel-based conditional independence test and application in causal discovery. Arxiv Preprint:1202.3775","author":"Zhang Kun","year":"2012"},{"key":"e_1_2_2_112_1","doi-asserted-by":"publisher","DOI":"10.1093\/nsr\/nwx137"},{"key":"e_1_2_2_113_1","volume-title":"Proceedings of the Conference and Workshop on Neural Information Processing Systems (NeurIPS\u201919)","author":"Zhang Muhan","year":"2019"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3409382","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3409382","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:38:40Z","timestamp":1750185520000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3409382"}},"subtitle":["Methods and Evaluations"],"short-title":[],"issued":{"date-parts":[[2020,9,28]]},"references-count":113,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9,30]]}},"alternative-id":["10.1145\/3409382"],"URL":"https:\/\/doi.org\/10.1145\/3409382","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,28]]},"assertion":[{"value":"2019-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}