Migration Notes: Data Foundation or EDG 9.3 to 9.4

Data Platform upgrade

Deployments that use Data Platform must also upgrade the Data Coordinator server to version 2.0.0-tq-5.

Vector Index re-indexing

The language models shipped with the Embedding Service now produce slightly different embedding vectors, because they are quantized so that a model returns the same vectors on every x86 host. The difference to the vectors stored by an earlier release is usually below 1%, so the Vector Index keeps working. Re-indexing is still recommended to get the best quality results from Crosswalks, Copilot Linking and the AutoClassifier.

Re-index every asset collection that has the Vector Index enabled, as described under Changing the Vector Index Configuration:

  • Delete the Vector Index

  • Create the Vector Index

  • Push to Vector Index