Arranging letters in the most pronounceable way?

前端 未结 2 634
误落风尘
误落风尘 2021-02-05 13:22

I have a string with some characters, and I\'m looking for the organization of those characters such that it\'s the most pronounceable possible.

For example, if I have

2条回答
  •  面向向阳花
    2021-02-05 14:03

    Start by solving a simpler problem: is a given word pronounceable?

    Machine learning 'supervised learning' could be effective here. Train a binary classifier on a training set of dictionary words and scrambled words (assume the scrambled words are all unpronounceable). For features, I suggest counting bigrams and trigrams. My reasoning: unpronounceable trigrams such as 'tns' and 'srh' are rare in dictionary words, even though the individual letters are each common.

    The idea is that the trained algorithm will learn to classify words with any rare trigrams as unpronounceable, and words with only common trigrams as pronounceable.


    Here's an implementation with scikit-learn http://scikit-learn.org/

    import random
    def scramble(s):
        return "".join(random.sample(s, len(s)))
    
    words = [w.strip() for w in open('/usr/share/dict/words') if w == w.lower()]
    scrambled = [scramble(w) for w in words]
    
    X = words+scrambled
    y = ['word']*len(words) + ['unpronounceable']*len(scrambled)
    
    from sklearn.model_selection import train_test_split
    X_train, X_test, y_train, y_test = train_test_split(X, y)
    
    from sklearn.pipeline import Pipeline
    from sklearn.feature_extraction.text import CountVectorizer
    from sklearn.naive_bayes import MultinomialNB
    
    text_clf = Pipeline([
        ('vect', CountVectorizer(analyzer='char', ngram_range=(1, 3))),
        ('clf', MultinomialNB())
        ])
    
    text_clf = text_clf.fit(X_train, y_train)
    predicted = text_clf.predict(X_test)
    
    from sklearn import metrics
    print(metrics.classification_report(y_test, predicted))
    

    It scores 92% accuracy. Given pronounceability is subjective anyway, this might be as good as it gets.

                     precision    recall  f1-score   support
    
          scrambled       0.93      0.91      0.92     52409
               word       0.92      0.93      0.93     52934
    
        avg / total       0.92      0.92      0.92    105343
    

    It agrees with your examples:

    >>> text_clf.predict("scaroly crasoly oascrly yrlcsoa".split())
    ['word', 'word', 'unpronounceable', 'unpronounceable']
    

    For the curious, here are 10 scrambled words it classifies pronounceable:

    • moro garapm ocenfir onerixoatteme arckinbo raetomoporyo bheral accrene cchmanie suroatipsheq

    And finally 10 dictionary words misclassified as unpronouncable:

    • ilch tohubohu usnea halfpaced pyrostilpnite lynnhaven cruel enure moldproof piecemeal

提交回复
热议问题