论文阅读 word2box

这几天在学习word2box,读了四篇论文:

1. Probabilistic Embedding of Knowledge Graphs with
   Box Lattice Measures

2. Box Embeddings: An open-source library for representation learning
   using geometric structures

3. Word2Box: Learning Word Representation Using Box Embeddings

4. Word2Box: Capturing Set-Theoretic Semantics of Words using Box
   Embeddings

知识准备

Order embedding

https://en.wikipedia.org/wiki/Order_embedding

In order theory, a branch of mathematics, an order embedding is a special kind of monotone function, which provides a way to include one partially ordered set into another. Like Galois connections, order embeddings constitute a notion which is strictly weaker than the concept of an order isomorphism. Both of these weakenings may be understood in terms of category theory.

简单来讲就是讲一个偏序关系嵌入到另一个偏序关系.

max margin loss

Probabilistic Embedding of Knowledge Graphs with Box Lattice Measures

本篇论文讲解了word2box的数学原理。

Box Embeddings: An open-source library for representation learning using geometric structures

本篇论文讲解了word2box的实现的细节。

box embdeeing 的定义，box volume的计算，box embdeeing的相关运算
box embedding 的应用： word层次图表示，NLI(balure language inference)