Fig. 2: From arXiv to Science4Cast. | Nature Machine Intelligence

Fig. 2: From arXiv to Science4Cast.

From: Forecasting the future of artificial intelligence with machine learning-based link prediction in an exponentially growing knowledge network

Fig. 2: From arXiv to Science4Cast.

Utilizing 143,000 AI and ML papers on arXiv from 1992 to 2020, we create a list of concepts using RAKE and other NLP tools, which form nodes in a semantic network. Edges connect concepts that co-occur in titles or abstracts, resulting in an evolving network that expands as more concepts are jointly investigated. The task involves predicting which unconnected nodes (concepts not yet studied together) will connect within a few years. We present ten diverse statistical and ML methods to address this challenge.

Back to article page