Relational information gain.

Saved in:
Bibliographic Details
Title: Relational information gain.
Authors: Lippi, Marco1 lippi@dsi.unifi.it, Jaeger, Manfred2, Frasconi, Paolo1, Passerini, Andrea3
Source: Machine Learning. May2011, Vol. 83 Issue 2, p219-239. 21p.
Subjects: Electronic data processing, Horn clauses, Entropy (Information theory), Search algorithms, Decision trees, Data modeling
Abstract: We introduce relational information gain, a refinement scoring function measuring the informativeness of newly introduced variables. The gain can be interpreted as a conditional entropy in a well-defined sense and can be efficiently approximately computed. In conjunction with simple greedy general-to-specific search algorithms such as FOIL, it yields an efficient and competitive algorithm in terms of predictive accuracy and compactness of the learned theory. In conjunction with the decision tree learner TILDE, it offers a beneficial alternative to lookahead, achieving similar performance while significantly reducing the number of evaluated literals. [ABSTRACT FROM AUTHOR]
Copyright of Machine Learning is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:We introduce relational information gain, a refinement scoring function measuring the informativeness of newly introduced variables. The gain can be interpreted as a conditional entropy in a well-defined sense and can be efficiently approximately computed. In conjunction with simple greedy general-to-specific search algorithms such as FOIL, it yields an efficient and competitive algorithm in terms of predictive accuracy and compactness of the learned theory. In conjunction with the decision tree learner TILDE, it offers a beneficial alternative to lookahead, achieving similar performance while significantly reducing the number of evaluated literals. [ABSTRACT FROM AUTHOR]
ISSN:08856125
DOI:10.1007/s10994-010-5194-7