Final Project with Pyspark and Sparkr Assignment

Assignment Task

The final project should address an analytic problem or be driven by your literature review. It must be developed in PySpark or SparkR environments and the results should be achieved through one of them. The project is to be done individually. The below items are to be added to the workflow of the project:

• A programming over GitHub.
• The project should be performed on two different platforms (AWS, DataBricks, Google Cloud, local installation, etc.)

• Project Proposal (10 points), Due date: 03/10/2023, submission through Moodle
  • Problem statement (including but not limited to) motivation, introducing the data and
    the topic, and the project scope.
  • Data source, and description of the data set (including the data dictionary)
• Project Introduction  
  • Literature review (including citation), identifying the gap in the literature
  • Research questions, and the significance of the study
  • Descriptive statistics, and visualizations
• Final products 
  • Presentation (YouTube)
  • Final Report as below:
    • It should include the previous deliverables and these: methods, analyzes,
      conclusions, business suggestions, codes, and software outputs.
    • There is no specific instruction on how many lines or pages of write-ups should be delivered but each  section  of  the  report  should  be  well-developed  and  explained clearly.
    • In this report, students must submit a complete project as described above.
    • This report should be comprehensive and reproducible. It means TA or instructor should use the codes and data and reproduce the same outputs.
  • Important Points:
    • The project is not just an implementation of a python project in the Spark environment.
      The expectation is much more. It should be a professional report.
    • You can use your knowledge in other programming languages such as R, SQL, etc.
    • According to CRISP-DM, your project is a cyclical It means you  should  try  to improve the performance of your project and try at least 3 different approaches. Here is a link to know more about this standard
    • You should provide clear and well-developed comments, so everyone who reads your
      codes can understand the workflow.
    • You may submit a video though zoom.
    • A good “Literature Review” means reading plenty of scientific papers and citing them

This It Computer Science have been solved by our PhD Experts at My Uni Paper. Our Assignment Writing Experts are efficient in providing a fresh solution to this question. We are serving more than 10000+ Students in Australia, the UK, and the US by helping them to score HD in their academics. Our Experts are well-trained to follow all marking rubrics and referencing styles.

Be it a used or new solution, the quality of the work submitted by our assignment experts remains unhampered. You may continue to expect the same or even better quality with the used and new assignment solution files respectively. There’s one thing to be noticed you could choose one between the two and acquire an HD either way. You could choose a new assignment solution file to get yourself an exclusive, plagiarism (with free Turnitin file), expert quality assignment or order an old solution file that was considered worthy of the highest distinction.