DOCSLIB.ORG

ALGOHUB: a WEBSITE of ALGORITHMS a Project Presented to the Faculty of California State Polytechnic University, Pomona in Partia

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ALGOHUB: a WEBSITE of ALGORITHMS a Project Presented to the Faculty of California State Polytechnic University, Pomona in Partia ALGOHUB: A WEBSITE OF ALGORITHMS A Project Presented to the Faculty of California State Polytechnic University, Pomona In Partial Fulfillment Of the Requirements for the Degree Master of Science In Computer Science By Liang Zhang 2017 SIGNATURE PAGE PROJECT: ALGOHUB: A WEBSITE OF ALGORITHMS AUTHOR: Liang Zhang DATESUBMITTED: Fall 2017 Computer Science Department Dr. Gilbert S. Young Project Committee Chair Computer Science Dr. Hao Ji Computer Science ii ACKNOWLEDGEMENTS First, I would like to thank my wife, Yatong Liang, for her supporting not only on my study, but also in all aspects of my life. Thanks all the professors I have met in CalPoly Pomona, especially Dr. Young, and Dr. Ji, who taught me knowledge, tutored my research, and encouraged me overcoming the barricades. Last but not the least, thanks all the developers, who are contributing to the open source projects, for building so many wonderful software. Without your works, I couldn’t have finished my project. iii ABSTRACT In this project, a website (AlgoHub) is implemented, which mainly hosts contents of algorithms, such as title, algorithm description, applications, and so on. From the functionality perspective, modules like adding, modifying, searching, fulfills the requirements of different groups of users (students, teachers, software engineers, and etc.) who are interested in algorithms. From the technology perspective, the system architecture of AlgoHub is designed to achieve high performance and scalability according to the nature of this application. During the implementation, rather than building a website from scratch, many practically proved technologies and existing components, such as Jekyll, Jenkins, Git, and so on, are utilized after being carefully evaluated. iv TABLE OF CONTENTS SIGNATURE PAGE .......................................................................................................... ii ACKNOWLEDGEMENTS ............................................................................................... iii ABSTRACT ....................................................................................................................... iv LIST OF FIGURES .......................................................................................................... vii CHAPTER 1: INTRODUCTION ....................................................................................... 1 CHAPTER 2: PRODUCT DESIGN ................................................................................... 3 2.1 Properties of an Algorithm .................................................................................... 3 2.2 Homepage ............................................................................................................. 4 2.3 View Algorithm Page ........................................................................................... 4 2.4 Add Algorithm Page ............................................................................................. 6 2.5 Edit Algorithm Page ............................................................................................. 8 2.6 Search Algorithm Page ......................................................................................... 8 CHAPTER 3: ENGINEERING DESIGN ........................................................................ 10 3.1 Manager .............................................................................................................. 13 3.2 Generator ............................................................................................................. 13 3.3 Searcher ............................................................................................................... 14 3.4 Infrastructure ....................................................................................................... 14 CHAPTER 4: TECHNOLOGIES ..................................................................................... 15 4.1 Event-based Programming .................................................................................. 15 4.2 Container ............................................................................................................. 21 4.3 CI/CD .................................................................................................................. 25 CHAPTER 5: CONCLUSION AND FUTURE WORKS ................................................ 29 REFERENCES ................................................................................................................. 31 v APPENDIX A: QUESTION IN CS530 ONLINE EXAM ............................................... 33 vi LIST OF FIGURES Figure 1:Homepage Mockup .............................................................................................. 4 Figure 2: View Algorithm Mockup .................................................................................... 5 Figure 3: Add Algorithm - Other steps ............................................................................... 6 Figure 4: Add Algorithm - Step 1 ....................................................................................... 6 Figure 5: Markdown editor UI (Simplemde) ...................................................................... 7 Figure 6: Embedded Search ................................................................................................ 9 Figure 7: AlgoHub System Architecture .......................................................................... 12 Figure 8: Blocking Execution ........................................................................................... 15 Figure 9: Non-blocking Execution .................................................................................... 16 Figure 10: A Use Case of Non-blocking ........................................................................... 16 Figure 11: Callback Hell ................................................................................................... 17 Figure 12: Promise in ES6 ................................................................................................ 18 Figure 13: Promise with Branch Statements ..................................................................... 19 Figure 14: Example of Async/Await ................................................................................ 20 Figure 15: Combine Await/Async with Promise .............................................................. 20 Figure 16: Processes of a Container and the Application Inside ...................................... 21 Figure 17: User Container as a Command Line Tool ....................................................... 22 Figure 18: Containers in Development Environment ....................................................... 22 Figure 19: A Simple Dockerfile ........................................................................................ 23 Figure 20: Command to Build an Image ........................................................................... 23 Figure 21: Command to Push an Image ............................................................................ 23 vii Figure 22: Docker Swarm Load Balance .......................................................................... 24 Figure 23: Commands to Control a Service ...................................................................... 25 Figure 24: Jenkinsfile for Manage Module ....................................................................... 26 Figure 25: Screenshot of Jenkins Pipeline Report ............................................................ 27 viii CHAPTER 1: INTRODUCTION In computer science, an algorithm is basically an instance of logic written in software by software developers to be effective for the intended “target” computer(s) to produce output from given (perhaps null) input [1]. People search online for an algorithm for interest more than in textbooks nowadays, thanks to the well-developed websites hosting rich content. Audience: Most people searching an algorithm have different purposes. Educators, such as professors in colleges, may be interested in some novel educating methods to effectively teach algorithms in their classes. Students may look for a course video to help refreshing their knowledge, find sample codes to help finishing their homework, or research on relevant algorithms to the ones learned in their classes to extend the scale of knowledge. Software engineers may look for algorithms to build their applications, or learn the practical implementation in a specific programming language. Why AlgoHub? A lot of websites are providing contents of algorithms, which include personal blogs, search engines and knowledge databases (Wikipedia is one of the most popular). Despite the large number of websites out there, we can still hardly find one specifically designed to fulfill the requirements of all of our audiences. In this project, a website (http://www.algohub.me) was implemented to host contents of algorithms. In the feature perspective, it was designed to satisfy the requirements of the audiences, who use the website for different purposes. In the technology perspective, some modern technologies were leveraged in this project, such as server-less, and event-based programming. Moreover, performance and scalability were also taken into account according to the nature of this application. 1 In the rest of the report, I will go through: product design, which explains the page layouts and interactions; engineering design, which covers the implementation details of the modules; technologies, which
Load more

Recommended publications
  • | Jekyll Documentation Theme — Designers
    Jekyll Documentation Theme for Designers version 3.0 Last generated: September 13, 2015 © 2015 Your company's copyright information... All rights reserved. No part of this book may be reproduced in any form or by any electronic or mechanical means, including information storage and retrieval systems, without written permission from the author, except in the case of a reviewer, who may quote brief passages embodied in critical articles or in a review. Trademarked names appear throughout this book. Rather than use a trademark symbol with every occurrence of a trademarked name, names are used in an editorial fashion, with no intention of infringement of the respective owner’s trademark. The information in this book is distributed on an “as is” basis, without warranty. Although every precaution has been taken in the preparation of this work, neither the author nor the publisher shall have any liability to any person or entity with respect to any loss or damage caused or alleged to be caused directly or indirectly by the information contained in this book. Jekyll Documentation Theme for Designers User Guide PDF last generated: September 13, 2015 Table of Contents Getting started Introduction .............................................................................................................................. 1 Getting started with this theme ................................................................................................ 3 Setting configuration options ..................................................................................................
    [Show full text]
  • Gitlab Letsencrypt and Certbot
    Gitlab and Certbot – Lets Encrypt SSL and HTTPS In this post we will talk about HTTPS and how to add it to your GitLab Pages site with Let's Encrypt. Why TLS/SSL? When discussing HTTPS, it's common to hear people saying that a static website doesn't need HTTPS, since it doesn't receive any POST requests, or isn't handling credit card transactions or any other secure request. But that's not the whole story. TLS (formerly SSL) is a security protocol that can be added to HTTP to increase the security of your website by: 1. properly authenticating yourself: the client can trust that you are really you. The TLS handshake that is made at the beginning of the connection ensures the client that no one is trying to impersonate you; 2. data integrity: this ensures that no one has tampered with the data in a request/response cycle; 3. encryption: this is the main selling point of TLS, but the other two are just as important. This protects the privacy of the communication between client and server. The TLS layer can be added to other protocols too, such as FTP (making it FTPS) or WebSockets (making ws://wss://). HTTPS Everywhere Nowadays, there is a strong push for using TLS on every website. The ultimate goal is to make the web safer, by adding those three components cited above to every website. The first big player was the HTTPS Everywhere browser extension. Google has also been using HTTPS compliance to better rank websites since 2014. TLS certificates In order to add TLS to HTTP, one would need to get a certificate, and until 2015, one would need to either pay for it or figure out how to do it with one of the available Certificate Authorities.
    [Show full text]
  • Gitlab Pages | Project Web Pages with GIT
    Gitlab Pages | Project web pages with GIT David Hrbáč TOC ▪ Intro ▪ Gitlab pages ▪ Static site generators ▪ Similar projects ▪ Hands-on Web pages process prerequisites ▪ Webmaster ▪ HTML, JS, CSS knowledge ▪ Webhosting ▪ webserver ▪ certificate would be nice ▪ DNS record ▪ FTP/SSH deploy ▪ Content Management System ▪ Backup ▪ Overcomplicated ▪ Many people involved Gitlab Pages ▪ Create websites for your GitLab projects, groups, or user account. ▪ Use any static website generator: Jekyll, Middleman, Hexo, Hugo, and more. ▪ Plain HTML pages (optional) ▪ Connect your custom domain(s) and TLS certificates. ▪ Host your static websites on GitLab.com for free, or on your own GitLab instance. ▪ https://code.it4i.cz How it works ▪ Built-in tool called GitLab CI/CD ▪ commit/push trigger ▪ CI/CD prescription .gitlab-ci.yml ▪ modify at your will ▪ enhance with source lint, typo correction, etc. ▪ Generate site ▪ Deploy public folder ▪ Enable certificate (optional) Static sites generators ▪ MKDocs - Python https://www.mkdocs.org ▪ Hugo - Go - https://gohugo.io ▪ Jekyll - Ruby - https://jekyllrb.com ▪ Gatsby - React - https://www.gatsbyjs.org ▪ Hexo - Node.js - https://hexo.io ▪ Sphinx - Python - http://www.sphinx-doc.org/en/master/ ▪ Middleman - Ruby - https://middlemanapp.com ▪ Markdown based ▪ List - https://www.staticgen.com Similar solutions ▪ Github pages ▪ free, static only, Jekyll based ▪ master branch or separate branch ▪ Harp (static) ▪ Heroku $ (Paas) ▪ Digital ocean $ (Iaas) Hands-on I. - Create new project 1. login to https://code.it4i.cz with account dd-19-34-xx 2. create new project 3. choose Create from template 4. locate Pages/Jekyll 5. hit button Use template 6. set project name 7. Visibility level set to Public 8.
    [Show full text]
  • EIC Software Website: an Update
    The EICUG Software Website - an update Maxim Potekhin (BNL, NPPS) 09/02/2020 Why are we here? ● For many organizations their website is an important tool and an asset. ● Moreso for knowledge-intensive fields like ours. ● Let’s take stock of where we are with the website, decide on what can be improved or changed, and define items for future development. ● The content is a separate topic, these slides are mostly “how-to”. 2 Overview ● The website has been online for ~6 months https://eic.github.io/ ● See presentation from April 2020 for intro and general idea of the site ○ https://docs.google.com/presentation/d/1WCVlVNZldHm8exHJBhILLngr9yEXHUP1w_BdwB4F41s/edit?usp=sharing ● Healthy level of contributions to the site from the team members ○ A proof that the system is reasonably user friendly ● Changes to the layout can be done quite quickly ○ Not a problem to create a new skin, menu, color scheme, layout etc ● GitHub based ○ Free hosting with service level we are happy with for now ○ Pull requests make collaboration easy ● How are things looking going forward? What have we learned? 3 Updated layout/menus - recent changes 4 Updated layout/menus, cont’d 5 The platform ● Static site = security + performance. ● Template-based, hence separation of content and layout ● Jekyll is one of a few available static website generators. ● Markdown/Jekyll/Liquid/Bootstrap + GitHub. ● Jekyll does allow for a fairly liberal mix of HTML and MD for considerable flexibility ○ ...with a few caveats ● YAML, CSV and JSON files containing configuration and data are transparently parsed - creating data structures in an intuitive way ○ Example: migration of data from Postgres requires one line of sql and nothing else ● Manipulation of structured data is perhaps the most important feature.
    [Show full text]
  • Modern Documentation Tools and Approaches
    Modern documentation tools and approaches ATLAS Software and Computing Documentation Workshop @GiordonStark and @MarioLassnig December 11th, 2017 https://indico.cern.ch/event/681173/ 1 Outline for today Community input Available tools Moving forward A summary of solicited What are some modern Can we move forward input from ATLAS tools available used and use more centralized community at-large elsewhere? tools? ● What do we use? ● How do these tools ● How might we ● What do we like? map to what the migrate to these ● What do we dislike? community uses? tools? 2 What are the main challenges? Challenge 1 Challenge 2 Challenge 3 Vague formats Out-of-date docs Lack of good search Good documentation Documentation often Above all, docs must be tools should be intuitive becomes stale or crusty. accessible. Users should and resilient. be able to search. If you Implementation is easy have to bookmark pages Users will not want to but maintenance is hard. because you can’t find it write documentation if How do we ensure otherwise, then discovery they don’t understand the documentation is needs to be improved. format or how to make it. up-to-date? 3 An email was sent out to solicit responses from the ATLAS Input community about their from the ATLAS community comments/suggestions 4 Existing tools - LXR - USATLAS has asked BNL to continue to maintain it as there is no modern tool with equivalent functionality - Can we replace LXR with GitLab search? Continue to support LXR? - Twiki - Must preserve twikis (no matter what?) - Mix of outdated and up-to-date docs - Comments about not being proactive and making changes to twiki - it doesn’t feel open? Difficult for external people to join.
    [Show full text]
  • Jekyll Theme for Documentation — Designers Version 4.0
    Jekyll theme for documentation — designers version 4.0 Last generated: December 02, 2015 © 2015 Your company. This is a boilerplate copyright statement... All rights reserved. No part of this publication may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, or other electronic or mechanical methods, without the prior written permission of the publisher, except in the case of brief quotations embodied in critical reviews and certain other noncommercial uses permitted by copyright law. Jekyll theme for documentation — designers User Guide PDF last generated: December 02, 2015 Table of Contents Overview Introduction .............................................................................................................................. 1 Supported features .................................................................................................................. 3 Get started 1. Build the default project ....................................................................................................... 8 2. Add a new project .............................................................................................................. 12 3. Decide on your project's attributes.................................................................................... 15 4. Set the configuration options ............................................................................................. 17 5. Customize the conditions file ............................................................................................
    [Show full text]
  • Ecosystems in Github and a Method for Ecosystem Identification Using
    Ecosystems in GitHub and a Method for Ecosystem Identification using Reference Coupling Kelly Blincoe, Francis Harrison and Daniela Damian Software Engineering Global InterAction Lab University of Victoria Victoria, BC, Canada Email: [email protected], [email protected], [email protected] Abstract—Software projects are not developed in isolation. To identify technical dependencies, we turn to cross- Recent research has shifted to studying software ecosystems, references on GitHub, a social code hosting service. GitHub communities of projects that depend on each other and are encourages collaboration between users both within and across developed together. However, identifying technical dependencies at the ecosystem level can be challenging. In this paper, we projects through its transparent interface and built-in social 1 propose a new method, known as reference coupling, for detecting features. With GitHub Flavored Markdown , when a user technical dependencies between projects. The method establishes cross-references another repository in a pull request, issue or dependencies through user-specified cross-references between commit comment a link to the other repository is automati- projects. We use our method to identify ecosystems in GitHub- cally created. This introduces a way for developers to bring hosted projects, and we identify several characteristics of the identified ecosystems. We find that most ecosystems are centered awareness across repositories. In this paper, we investigate around one project and are interconnected with other ecosystems. whether these cross-references indicate a technical dependency The predominant type of ecosystems are those that develop between the two repositories by examining a set of these tools to support software development. We also found that the cross-references.
    [Show full text]
  • Using Wax and Jekyll to Build Minimal Digital Projects Jo Klein Cass Wilkinson Saldaña Angela Zoss (Presenting)
    DLF 2020 Forum 25th Anniversary Using Wax and Jekyll to build minimal digital projects Jo Klein Cass Wilkinson Saldaña Angela Zoss (presenting) Why build digital projects minimally? Rising interest in digital scholarship over recent decades Challenges: ● Maintenance and ongoing labor ● Learning curve ● Access ● Accessibility ● Autonomy (hosted vs locally managed instances, open source) ● Surveillance ● Justice “I prefer to approach minimal computing around the question “What do we need?” ...we aim to understand ways of building that could be referred to as architectures of necessity…” “The User, the Learner and the Machines We Make” by Alex Gil (2015) via Minicomp What is Minicomp? “Minicomp is a collaborative effort in embedding minimal computing principles (e.g. Minimal Maintenance, Minimal Dependencies, and Minimal Connectivity) in digital humanities methods.” Minicomp Wiki Minimal computing values in digital projects Minimal: Maximum: ● Maintenance ● Access ● Dependencies ● Accessibility ● Obsolescence ● Ephemerality Minimal Definitions (tl;dr version), Jentery Sayers - 03 Oct 2016 "Origami stellated octahedron" by endolith is licensed under CC BY-SA 2.0 What is Wax? Wax builds on an existing website platform to create minimal digital exhibits. Archer Library - 50th Anniversary Town Hall University of Regina - Archer Library Proposals: Creative Speculations For Philadelphia Monument Lab & Mural Arts Philadelphia How Does Wax Work? First, a note about Jekyll ● Compiles plain text files into a full website ● Built on Ruby ● Has built-in
    [Show full text]
  • Blogging Platform Utilizing Kentico Cloud and Jekyll Static Site Generator
    Masaryk University Faculty of Informatics Blogging platform utilizing Kentico Cloud and Jekyll static site generator Master’s Thesis Radoslav Karlík Brno, Fall 2019 Masaryk University Faculty of Informatics Blogging platform utilizing Kentico Cloud and Jekyll static site generator Master’s Thesis Radoslav Karlík Brno, Fall 2019 This is where a copy of the official signed thesis assignment and a copy ofthe Statement of an Author is located in the printed version of the document. Declaration Hereby I declare that this paper is my original authorial work, which I have worked out on my own. All sources, references, and literature used or excerpted during elaboration of this work are properly cited and listed in complete reference to the due source. Radoslav Karlík Advisor: Bruno Rossi, PhD i Acknowledgements This way, I would like to thank my advisor Bruno Rossi for providing valuable feedback while writing this thesis and making sure that the work went in the right direction. iii Abstract This thesis aims to explore the possibilities of integrating the Kentico Cloud with Jekyll static site generator and reveal possible issues of the platform. As a result, there are two implementations. The first implementation is a plugin for the Jekyll framework that generates a website based on content from Kentico Cloud. The second imple- mentation is a sample blogging application using this plugin, that is subscribed to a webhook for content regeneration. iv Keywords Static site generators, Content management systems, Jekyll, Liquid, Kentico Cloud, Site regeneration, CMS integration v Contents 1 Introduction 1 1.1 Background ..........................1 1.2 Problem ............................1 1.3 Contributions .........................2 1.4 Thesis structure ........................2 2 Web applications 5 2.1 History of the Web ......................5 2.1.1 Initial ideas .
    [Show full text]
  • Mydoc.Pdf; Echo "Done";
    Jekyll theme for documentation — mydoc product version 6.0 Last generated: December 28, 2017 © 2017 Your company. This is a boilerplate copyright statement... All rights reserved. No part of this publication may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, or other electronic or mechanical methods, without the prior written permission of the publisher, except in the case of brief quotations embodied in critical reviews and certain other noncommercial uses permitted by copyright law. Jekyll theme for documentation — mydoc product User Guide PDF last generated: December 28, 2017 Table of Contents Overview Get started ............................................................................................................................... 3 Introduction ............................................................................................................................ 16 Supported features ................................................................................................................ 17 About the theme author ......................................................................................................... 22 Support................................................................................................................................... 23 Release Notes 6.0 Release notes................................................................................................................... 24 5.0 Release notes..................................................................................................................
    [Show full text]
  • Cross-Platform Software Developer Expertise Learning
    Cross-Platform Software Developer Expertise Learning by Norbert Eke A Thesis submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfilment of the requirements for the degree of Master of Computer Science in Computer Science with Specialization in Data Science Carleton University Ottawa, Ontario c 2020 Norbert Eke The undersigned recommend to the Faculty of Graduate and Postdoctoral Affairs acceptance of the Thesis Cross-Platform Software Developer Expertise Learning Submitted by Norbert Eke in partial fulfilment of the requirements for the degree of Master of Computer Science Dr. Olga Baysal, Thesis Supervisor Dr. Majid Komeili, Internal Examiner Dr. Diana Inkpen, External Examiner Dr. Ahmed El-Roby, Chair of Defence Dr. Michel Barbeau, Department Chair Carleton University 2020 ii Abstract In today's world software development is a competitive field. Being an expert gives software engineers opportunities to find better, higher-paying jobs. Recruiters are always searching for the right talent, but it is difficult to determine the expertise of a developer only from reviewing their resume. To solve this problem expertise detection algorithms are needed. A few problems arise when expertise is put into application: how can developer expertise be defined, measured, extracted or even learnt? Our work is attempting to provide recruiters a data-driven alternative to reading the candidate's CV or resume. In this thesis, we propose three novel topic modeling based, robust, data-driven techniques for expertise learning. Our extensive analysis of cross-platform developer expertise suggests that using multiple collaborative platforms is the optimal path towards gaining more knowledge and becoming an expert, as cross-platform expertise tends to be more diverse, thus creating opportunities for more effective learning by collaboration.
    [Show full text]
  • Next-Generation Academic Websites in Jekyll
    Next-generation academic websites in Jekyll Speaker: UCCSC! Peter Werba 2014 How do we share information in the modern era? Websites! wikipedia.org ucsf.edu nytimes.com A lot has changed 1999 2014 How do we make sure that our websites are: • available 24/7 (even with heavy traffic)! • easy to create, edit, and maintain! • scalable How did we work! last decade? • Dynamically generated pages in CMS systems! • Maintain our own servers and databases ! • HTML often edited in the browser What are the problems? • Configuring & maintaining servers & databases = HARD! • Editing HTML source = HARD We can do better! In fact, the software industry has moved on! What do they do? 1. HTML → TXT (with Markdown) 2. Dynamic → Static (with Jekyll) 3. Servers → Hosted (with GitHub) 1. What is Markdown? TXT files with! simple syntax that ! compile to HTML HTML MARKDOWN Why use Markdown? • Simple, fast, clean! • Portable to other formats! • Supports raw HTML (if you need to do something complicated)! • Widespread (and growing) adoption 2. What is Jekyll? Jekyll is a “static site” generator that converts source files! (markdown, etc.)! into a website Basics about Jekyll • Simple to install as a Ruby Gem, but no Ruby coding knowledge is required for use.! • Converts your code and Markdown posts into HTML! • An elegant and simple way to publish to the web. Why use Jekyll • SAFE from Denial of Service Attacks.! • SAFE from caving under heavy traffic (if served from GitHub pages or a CDN like cloudfront).! • SAFE from MySQL injection attacks (because it doesn't use a database).! • It needs NO security patches or updates.! • It doesn't need any special server script software (like php,python or ruby or perl etc).
    [Show full text]