Giter VIP home page Giter VIP logo

key1688's Introduction

Key1688

抓取阿里巴巴1688商品购物平台，并使设计成gui，导出成excel表格

               
抓取数据GUI的设计

抓取数据

  • 工具：chrome自带的抓包工具
  • 方法：打开Chrome自带的抓包工具，进行监控，对提交的数据，进行检测，
  • 然后利用字典，将数据排序，编码
  • 提交给后台页面，它会反馈回我们一个页面，这个页面就是我们搜取得结果
  • 我们看看翻页怎么翻，就是在参数里，每个网站的翻页不一样，京东，淘宝，都有自己的一套逻辑
  • 然后进行翻页（设置参数，提交到后台，得到结果）
  • 结果，我们看的都是在一个模块里，我们想将模块一个一个的提取出来，然后再在模块里提取出我们想要的东西
  • 因为这样的话，我们会将数据一一对应起来，比如，有的商品少了价格，然后你后面的补到前面的上面来了，肯定不对 Csv的读写参考
  • 将提取出来的结果保存在csv里。这样的话，看起来更加的舒服了

设计成GUI

  • 我们要将关键字分装在一个输入格里
  • 然后得出结果，反馈给页面

key1688's People

Contributors

xuanmofeng avatar

Watchers

James Cloos avatar avatar

Forkers

samchen1981 disgaohou

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.