{"id":645,"date":"2013-08-28T07:03:52","date_gmt":"2013-08-28T12:03:52","guid":{"rendered":"http:\/\/haleyai.com\/wordpress\/?p=645"},"modified":"2018-10-20T16:57:13","modified_gmt":"2018-10-20T21:57:13","slug":"automatic_knowledge_graphs_for_assessment_items_and_learning_objects","status":"publish","type":"post","link":"http:\/\/haleyai.com\/wordpress\/2013\/08\/28\/automatic_knowledge_graphs_for_assessment_items_and_learning_objects\/","title":{"rendered":"Automatic Knowledge Graphs for Assessment Items and Learning Objects"},"content":{"rendered":"

As I mentioned in this post<\/a>, we’re having fun layering questions and answers with explanations on top of electronic textbook content.<\/p>\n

\"\"<\/a><\/p>\n

The basic idea is to couple a graph structure of questions, answers, and explanations into the text using semantics.\u00a0 The trick is to do that well and automatically enough that we can deliver effective adaptive learning support.\u00a0 This is analogous to the knowledge graph that users of Knewton<\/a>‘s API create for their content.\u00a0 The difference is that we get the graph from the content, including the “assessment items” (that’s what educators call questions, among other things).\u00a0 Essentially, we parse the content, including the assessment items (i.e., the questions and each of their answers and explanations).\u00a0\u00a0 The result of this parsing is, as we’ve described elsewhere<\/a>, precise lexical, syntactic, semantic, and logic understanding of each sentence in the content.\u00a0 But we don’t have to go nearly that far to exceed the state of the art here.<\/strong><\/p>\n

We automatically import the text, break it into sentences organized with respect to the document structure (i.e., in an outline of groups, per chapter, section, …), and parse them.\u00a0 We keep track of the ambiguities in the normal workflow of collaborative curation supported by the Linguist™ but proceed with the best parse according to statistical NLP.\u00a0 The result of this is a set of logical terms using normalized vocabulary.\u00a0 The automated parsing cannot go as far as to produce a logical formula, but that is more than we need (we’re not actually trying to answer the questions, as we were in Project Sherlock!)!<\/p>\n

Across all the sentences, including the questions and explanations of answers, we have a graph of terms and inter-term relationships that supports algorithms such as inter-sentence comparison and contrasting.\u00a0 Think of this graph as a semantic network (e.g., one represented in RDF).\u00a0 This semantic network is further enriched by a semantic web ontology (e.g., expressed in OWL) which is semi-automatically derived from the content.\u00a0 For example, when we see a term like “accounting information”, we know it is information and we automatically acquire that net assets and total assets are both assets.\u00a0 We also automatically acquire that equipment is purchased by corporations, that net assets are calculated, that a reporting process is a process modified by a gerund derived from the verb report, and a lot more.<\/p>\n

Well, I’m drifting off the thought that had me start this post, so I’ll just show you a picture for now and move on below:<\/p>\n

\"\"<\/a><\/p>\n

Personally, I’m interested in the difficulties that collaborating contributors sometimes face in disambiguating language.\u00a0 In looking at the automated parse results for some of these sentences, I saw the following residual:<\/p>\n

\"\"<\/a><\/p>\n

How would you choose?\u00a0 Is the communication or the information for the purpose of making decisions?\u00a0 Does it matter?<\/p>\n

The following shows some of the results for one choice:<\/p>\n

\"\"<\/a><\/p>\n

Note: there is a bug in the renderings of the existentials in the live code I am working with (i.e., don’t worry about it, but the words make and decision should be there).<\/p>\n

This gives you an idea of the semantic information that we can acquire automatically and which can be curated to an arbitrary level of precision where appropriate.<\/p>\n

Bottom line: the approach holds great promise for curation of assessment items and learning objects into a collaboratively developed adaptive learning platform.<\/p>\n","protected":false},"excerpt":{"rendered":"

As I mentioned in this post, we’re having fun layering questions and answers with explanations on top of electronic textbook content. The basic idea is to couple a graph structure of questions, answers, and explanations into the text using semantics.\u00a0 The trick is to do that well and automatically enough that we can deliver effective … <\/p>\n

Continue reading “Automatic Knowledge Graphs for Assessment Items and Learning Objects”<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[535,16,17,22],"tags":[583,585,582,536,897,537,584,521,587,588,586,527,545,589,590],"class_list":["post-645","post","type-post","status-publish","format-standard","hentry","category-educational-technology","category-natural-language","category-ontology","category-semantic-web","tag-adaptive-learning","tag-assessment-items","tag-collaborative-curation","tag-e-learning","tag-educational-technology","tag-electronic-textbooks","tag-flat-world-knowledge","tag-inquire","tag-knewton","tag-knowledge-graph","tag-learning-objects","tag-linguist","tag-project-sherlock","tag-semantic-network","tag-statistical-nlp"],"_links":{"self":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/645","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/comments?post=645"}],"version-history":[{"count":9,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/645\/revisions"}],"predecessor-version":[{"id":1573,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/posts\/645\/revisions\/1573"}],"wp:attachment":[{"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/media?parent=645"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/categories?post=645"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/haleyai.com\/wordpress\/wp-json\/wp\/v2\/tags?post=645"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}