Finding closest neighbour using optimized Levenshtein Algorithm

后端 未结 1 1120
忘掉有多难
忘掉有多难 2020-11-27 21:57

I recently posted a question about optimizing the algorithm to compute the Levenshtein Distance, and the replies lead me to the Wikipedia article on Levenshtein Distance.

相关标签:
1条回答
  • 2020-11-27 22:53

    I've done it a number of times. The way I do it is with a recursive depth-first tree-walk of the game tree of possible changes. There is a budget k of changes, that I use to prune the tree. With that routine in hand, first I run it with k=0, then k=1, then k=2 until I either get a hit or I don't want to go any higher.

    char* a = /* string 1 */;
    char* b = /* string 2 */;
    int na = strlen(a);
    int nb = strlen(b);
    bool walk(int ia, int ib, int k){
      /* if the budget is exhausted, prune the search */
      if (k < 0) return false;
      /* if at end of both strings we have a match */
      if (ia == na && ib == nb) return true;
      /* if the first characters match, continue walking with no reduction in budget */
      if (ia < na && ib < nb && a[ia] == b[ib] && walk(ia+1, ib+1, k)) return true;
      /* if the first characters don't match, assume there is a 1-character replacement */
      if (ia < na && ib < nb && a[ia] != b[ib] && walk(ia+1, ib+1, k-1)) return true;
      /* try assuming there is an extra character in a */
      if (ia < na && walk(ia+1, ib, k-1)) return true;
      /* try assuming there is an extra character in b */
      if (ib < nb && walk(ia, ib+1, k-1)) return true;
      /* if none of those worked, I give up */
      return false;
    }
    

    Added to explain trie-search:

    // definition of trie-node:
    struct TNode {
      TNode* pa[128]; // for each possible character, pointer to subnode
    };
    
    // simple trie-walk of a node
    // key is the input word, answer is the output word,
    // i is the character position, and hdis is the hamming distance.
    void walk(TNode* p, char key[], char answer[], int i, int hdis){
      // If this is the end of a word in the trie, it is marked as
      // having something non-null under the '\0' entry of the trie.
      if (p->pa[0] != null){
        if (key[i] == '\0') printf("answer = %s, hdis = %d\n", answer, hdis);
      }
      // for every actual subnode of the trie
      for(char c = 1; c < 128; c++){
        // if it is a real subnode
        if (p->pa[c] != null){
          // keep track of the answer word represented by the trie
          answer[i] = c; answer[i+1] = '\0';
          // and walk that subnode
          // If the answer disagrees with the key, increment the hamming distance
          walk(p->pa[c], key, answer, i+1, (answer[i]==key[i] ? hdis : hdis+1));
        }
      }
    }
    // Note: you have to edit this to handle short keys.
    // Simplest is to just append a lot of '\0' bytes to the key.
    

    Now, to limit it to a budget, just refuse to descend if hdis is too large.

    0 讨论(0)
提交回复
热议问题