How can I visualise a hierarchical ontology of items in embedding space, combining text embeddings with the graphical structure? (Something similar to the example below)
I have a hierarchical ontology or DAG with at least one item matched to each document, and each document has its own embedding. I'd like to create a visualisation that combines both the ontology structure and the semantic distribution of the documents.
I am thinking for each ontology node, I can compute the density of the embeddings of all documents linked to it (and its children), and the position & size would somehow be linked to the density. Perhaps using something like t-SNE or UMAP on the embeddings could also be done before getting the density for each node. I imagine it would be interesting to view the same graph with different layers/overlays of the points/clouds of points and the centroids of ontology nodes.
I have not been able to find anything describing this in the literature, but would love if someone can point me in the right direction / has any ideas on how to go about executing this.
