SIT772: Database and Information Retrieval - Search Engine Development - Computer Science Assessment Answer

Download Solution Order New Solution
Internal Code: 1AHJJF Code: SIT772

Database and Information Retrieval Assessment Answer

Assignment Task: SIT772 Question 1 - SIT772 Suppose you have joined a search engine development team to design a search algorithm based on both the Vector model and the Boolean model. You have collected the following documents (unstructured) and plan to apply an indexing technique to convert them into an inverted index. SIT772 Doc 1Data science is an interdisciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge and insights from data in various forms, both structured and unstructured. Doc 2Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Doc 3: Information systems is the study of complementary networks of hardware and software that people and organizations use to collect, filter, process, create, and distribute data. SIT772 Assessment Information - SIT772 In the process of creating the inverted index, please complete the following steps: Remove all stop words and punctuation from the documents. The list of stop words for this task is provided as  follows: SIT772
  • Is, An, That, Use, And, To, From, In, Both, Of, At, The Create a merged inverted list including the within-document frequencies for each term.
Use the index created as above to create a dictionary and the related posting file. You may like to test the inverted index by using the following keywords:
  • data, system, algorithm Please design three Boolean queries, (for example, web AND search) and list the relevant documents for each query. SIT772
Please use the Vector model to query on the inverted index, and compare the result with the Boolean model. (Hint: you can use cosine similarity and set a similarity threshold). Question 2 (IR Evaluation) - SIT772 In this question, you are required to evaluate the performance of different search engines. First, please find two search engines you are familiar with, such as Google, Bing, Yahoo!, etc. Second, please choose one target from the following list, and design two queries to search in both search engines. So both query 1 and query 2 have to be tested in both search engines. SIT772
  • Target 1: obtain the course information for SIT772.
  • Target 2: obtain the price of the new iPad.
  • Target 3: obtain the manual of installing tera term.
  • Target 4: obtain the Oracle SQL tutorial.
  • Target 5: obtain the price of the new Xbox One.
Third, select the first 20 results in both search engines, if they return the target, then mark them as relevant documents, otherwise, they are irrelevant. Assume that you have 14 relevant documents in total (retrieved and not-retrieved). SIT772 The following questions are based on your search results. List your target, results and designed search queries (You can use any keywords you think are related to the target). Get the precision and recall values for 20 documents for query 1 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into a chart. SIT772 Get the precision and recall values for 20 documents for query 2 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into the same chart as above. Now find the average precision of query 1 and query 2 for search engine 1 and plot it into the same chart. So you will have a total of 3 curves in one single chart. List your target, results and designed search queries Get the precision and recall values for 20 documents for query 1 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into a chart. SIT772 Assessment Information - SIT772 Get the precision and recall values for 20 documents for query 2 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into the same chart as above Now find the average precision of query 1 and query 2 for search engine 2 and plot it into the same chart. So, you will have a total of 3 curves in one single chart, separate to that of part (a). SIT772 Plot the averages for Search Engine 1 and Search Engine 2 on a separate chart, and compare the algorithms in terms of precision and recall. Which search engine do you think is superior? Why? SIT772
This SIT772: Database and Information Retrieval Assessment has been solved by our IT experts at My Uni Paper. Our Assignment Writing Experts are efficient to provide a fresh solution to this question. We are serving more than 10000+ Students in Australia, UK & US by helping them to score HD in their academics. Our Experts are well trained to follow all marking rubrics & referencing style.

Get It Done! Today

Country
Applicable Time Zone is AEST [Sydney, NSW] (GMT+11)
+

Every Assignment. Every Solution. Instantly. Deadline Ahead? Grab Your Sample Now.