{"id":250,"date":"2012-11-20T17:48:50","date_gmt":"2012-11-20T17:48:50","guid":{"rendered":"http:\/\/alexboisvert.com\/musings\/?p=250"},"modified":"2014-02-16T11:04:51","modified_gmt":"2014-02-16T19:04:51","slug":"wikipedia-regex-search-updated","status":"publish","type":"post","link":"https:\/\/alexboisvert.com\/musings\/2012\/11\/20\/wikipedia-regex-search-updated\/","title":{"rendered":"Wikipedia Regex Search Updated"},"content":{"rendered":"

The news first: I’ve updated the Wikipedia Regex Search<\/a> to include Wiktionary in its results. The Wikipedia results have also been updated to be current as of November 1st.<\/p>\n

Now the problem: to test it out, I attempted to solve the most recent Matt Gaffney Contest<\/a> using the search, but it didn’t turn anything up<\/a>. Why? Because “Oracle of Omaha” isn’t a full-fledged Wikipedia page, just a redirect, and I exclude redirects from my results.<\/p>\n

So what’s the fix here? The obvious fix is to include redirects in my results, but I can’t just include all of them wholesale. Just look at all the pages that redirect to “Condoleezza Rice”<\/a> to see why. No thanks.<\/p>\n

So is there a way to be more judicious about choosing which redirects to use? There must be; after all, Onelook seems to handle it just fine. I’m thinking for now to compare each redirect to a list of known “good” results, maybe from my clue database or the collaborative word list<\/a>. If a redirect page appears in one of those, then maybe I could include it and just give it the same score as the page it redirects to. (Incidentally, it is in my clue database, but not the collaborative word list — I’ll have to add it.)<\/p>\n

Is there another way to determine which redirects to use? I’d love to hear suggestions. Anything I can do to improve my tool would be great.<\/p>\n","protected":false},"excerpt":{"rendered":"

The news first: I’ve updated the Wikipedia Regex Search to include Wiktionary in its results. The Wikipedia results have also been updated to be current as of November 1st. Now the problem: to test it out, I attempted to solve … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-250","post","type-post","status-publish","format-standard","hentry","category-coding"],"_links":{"self":[{"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/posts\/250","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/comments?post=250"}],"version-history":[{"count":2,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/posts\/250\/revisions"}],"predecessor-version":[{"id":345,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/posts\/250\/revisions\/345"}],"wp:attachment":[{"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/media?parent=250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/categories?post=250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/alexboisvert.com\/musings\/wp-json\/wp\/v2\/tags?post=250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}