Harnessing Deep Neural Networks With Logic Rules - ArXiv

Computer Science > Machine Learning arXiv:1603.06318 (cs) [Submitted on 21 Mar 2016 (v1), last revised 8 Aug 2020 (this version, v6)] Title:Harnessing Deep Neural Networks with Logic Rules Authors:Zhiting Hu, Xuezhe Ma, Zhengzhong Liu, Eduard Hovy, Eric Xing View a PDF of the paper titled Harnessing Deep Neural Networks with Logic Rules, by Zhiting Hu and 4 other authors View PDF

Abstract:Combining deep neural networks with structured logic rules is desirable to harness flexibility and reduce uninterpretability of the neural models. We propose a general framework capable of enhancing various types of neural networks (e.g., CNNs and RNNs) with declarative first-order logic rules. Specifically, we develop an iterative distillation method that transfers the structured information of logic rules into the weights of neural networks. We deploy the framework on a CNN for sentiment analysis, and an RNN for named entity recognition. With a few highly intuitive rules, we obtain substantial improvements and achieve state-of-the-art or comparable results to previous best-performing systems.

Comments:	Fix typos in appendix. ACL 2016
Subjects:	Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
Cite as:	arXiv:1603.06318 [cs.LG]
(or arXiv:1603.06318v6 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.1603.06318 Focus to learn more arXiv-issued DOI via DataCite

Submission history

From: Zhiting Hu [view email] [v1] Mon, 21 Mar 2016 03:33:20 UTC (172 KB) [v2] Thu, 14 Apr 2016 05:28:21 UTC (174 KB) [v3] Tue, 19 Jul 2016 23:30:48 UTC (174 KB) [v4] Tue, 15 Nov 2016 21:41:21 UTC (174 KB) [v5] Tue, 26 Mar 2019 05:16:10 UTC (174 KB) [v6] Sat, 8 Aug 2020 07:38:00 UTC (179 KB) Full-text links:

Access Paper:

View a PDF of the paper titled Harnessing Deep Neural Networks with Logic Rules, by Zhiting Hu and 4 other authors
• View PDF
• TeX Source
• Other Formats

view license Current browse context: cs.LG < prev | next > new | recent | 2016-03 Change to browse by: cs cs.AI cs.CL stat stat.ML

References & Citations

• NASA ADS
• Google Scholar
• Semantic Scholar

DBLP - CS Bibliography

listing | bibtex Zhiting HuXuezhe MaZhengzhong LiuEduard H. HovyEric P. Xing a export BibTeX citation

BibTeX formatted citation

× loading... Data provided by:

Bookmark

Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) Links to Code Toggle Papers with Code (What is Papers with Code?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) IArxiv recommender toggle IArxiv Recommender (What is IArxiv?)

• Author
• Venue
• Institution
• Topic

About arXivLabs arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)