Screenscraping

By

micro update web design devon

I recently had to look into ‘screenscraping’ information from one website to another. In this
instance it was taking products from eBay into Opencart shopping system.

Of course should be very straightforward you would think? There are loads of products out there that say eBay to Opencart. There are some issues:

  • Opencart v3 is not supported very well…
  • eBay structures change
  • eBay layout out information differently on a regular basis
  • Integration tools do not map the information correctly (this is a biggy!)
  • eBay to other shopping cart software solutions are VERY slow and most (if not all …) do not support HTML descriptions that are now available in Opencart v3 (more of this later!)
  • eBay’s long description is actually added to the page via an iFrame and not that easy to get at – also it allows the user to add all sorts of HTML that would not look consistent on a shopping site.
  • Plus a lot more!

So having gone through various ‘trials’ of integration tools, including:

  • Expandly (not very good support for OC v3) – does not map across HTML at all, misses MPU and other stock numbers or at least miss manages the field mapping – plus too many other things. Literally spent days on this one!
  • Linnworks
  • About 5 others…

Eventually I came up with the following list of tools.

We will go into a little detail with each one


SixBit management tool to integrate eBay with Other tools

Sixbit software tool to integrate eBay to other systems and manage eBay

Ok, for what we wanted, this software is superb! Yes, you have to pay a monthly fee (which is very reasonable BTW). BUT, you get a full client management tool that offers the following:

  • Integration with Amazon, eBay and ETSY
  • Excel and CSV import and export (this aspect is very very good!)
  • Pick list management
  • Packing list management
  • Shipping management
  • eMail management
  • Full reporting
  • Dropshipper management
  • … and a lot more

So, don’t WASTE your time like WE did with trying to scrape products and other information from eBay and the like. Use THIS TOOL to get the information, management your products and if you want to export so that you can import into OpenCart or any other shopping platform.

BRILLIANT… if you want to get products in and out of other systems from eBay and Amazon you do not need to read on – get this!!

SixBit software just does the job thanks!


Scraper (chrome plugin)

Scraper chrome plugin


Chropath
(chrome plugin)

Web Scraper by Martin Balodis (chrome plugin)

Advanced  Scraper by Agenty ($Commercial and trial version available)

Agenty

Data Miner ($Commercial and free version **)

** At the moment the free plan gives you 500 pages/month. The count resets monthly if you don’t exceed the 500 page limit in any given month. If you do exceed the 500 page scrapes in a given month your account will be automatically locked indefinitely. Then you can unlock your account by upgrading to any of our paid plans.

Data Miner

Other products to consider would be:

  • Greasemonkey scripts
  • Excel spreadsheet formulas

The process

I decided the best approach was to work out either the ‘xpath’ or ‘css’ structure of the eBay listing page. This was actually quite easy using the free chrome plugins.

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Test markdown with WordPress

By

micro update web design devon

Minimalist Markdown Editor

see syntax for this document here: <https://michelf.ca/projects/php-markdown/extra/>

download the jp markdown plugin

Continue reading “Test markdown with WordPress” »

1 Star2 Stars3 Stars4 Stars5 Stars (1 votes, average: 5.00 out of 5)
Loading...

How to guarantee your website is ranked in Google

By

quick tips top search engine optimisation ranking

Technical Article: Make sure your website is at the top of the search engines

If you want to get your website to rank at the top of the search engines, follow this in-depth article.

Here we explain detailed SEO Instructions on how to make sure you have all the correct SEO techniques.

Get your content ranked on Google!

Guarantee your article gets to be ranked on the first page of Google. There are other tools to complete this process that all professional search engine optimisation and content management companies will use – this blog post shows you the basics and uses largely free tools.

By using these tips and tricks for SEO optimisation, you will create blog articles that people will want to read and that will get you to page one of Google.

Follow these simple SEO Optimisation steps. If you write good articles and blogs that answers problems for users, and follow these steps, you will get your blog post ranked on Google. GOOD LUCK.

Continue reading “How to guarantee your website is ranked in Google” »
1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, average: 5.00 out of 5)
Loading...

Quick Tips on Using Keywords – Be seen on Page One of Google

By

quick tips using keywords to rank well in google and bing

Let’s start by defining what Keywords are… keywords are those words and expressions that people use within the search engines to find stuff.

They are usually looking for either Products or Problems (how to, where do I, what is the, etc.). Taking a step back it’s important to realise what all the major search engines do. Search engines have software programs that reach out into the web space and try to find everything that they think will be interesting to the public when they search – not only interesting – BUT also RELEVANT. Continue reading “Quick Tips on Using Keywords – Be seen on Page One of Google” »

1 Star2 Stars3 Stars4 Stars5 Stars (1 votes, average: 5.00 out of 5)
Loading...

Top SEO Tips for Business

By

quick tips top search engine optimisation ranking

This post concentrates on Top SEO Tips for business to make sure that your onpage and offpage SEO is complete. These techniques will ensure that you are doing the right things with the search engines and Google. Before you start any complicated SEO techniques you should ensure that all the items in this post have been completed for each page on your website. Google ranks relevancy to the search term entered by the user on the search page. Your web page or blog post should talk about the subject searched for and ensure you answer their question, completely and accurately with good relevance to their query. Continue reading “Top SEO Tips for Business” »

1 Star2 Stars3 Stars4 Stars5 Stars (2 votes, average: 5.00 out of 5)
Loading...

Quick Tips on getting Ranked on Google – Title Tag

By

SEO Title Tags MindMap

This article forms part of a series of quick tips for search engine optimisation on this blog. Please also see Quick Tips for OnPage Meta Descriptions and Quick Tips for OnPage Meta Keywords which explain more details about OnPage SEO Techniques for Search Engine Ranking.

Continue reading “Quick Tips on getting Ranked on Google – Title Tag” »

1 Star2 Stars3 Stars4 Stars5 Stars (1 votes, average: 5.00 out of 5)
Loading...

Quick Tips for OnPage SEO META Description

By

meta description tag top tips from micro update

Using the Meta Description to best advantage on your website

The META Description tag is always placed in the HEAD section of your webpage and is not visible on the actual webpage.

All search engines will use this description on the search engine results page (SERP) when someone types in search terms. The meta description is shown below the link to your webpage. It is important to SEO keyword this text.

Note: If the search engine cannot find good enough text within the meta description (keywords, etc.) it will take the first 150 characters from the content of your website – which is not always what you want!

Continue reading “Quick Tips for OnPage SEO META Description” »

1 Star2 Stars3 Stars4 Stars5 Stars (2 votes, average: 5.00 out of 5)
Loading...

Quick Tips for OnPage SEO Meta Keywords

By

quick tips using keywords to rank well in google and bing

Meta keywords are part of your onpage search engine optimisation techniques that you should build into every page as part of your website design process. Onpage SEO is an important part of ensuring that your website ranks well within the major search engines. Continue reading “Quick Tips for OnPage SEO Meta Keywords” »

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

How to beat your Competitors with a Web Competitor Analysis

By

competitor web analysis by micro update based in devon

Before any effective Ad campaign or website design or re-design you should analyse your market and your competitors. This is obvious in the business world and is even more important when it comes to your online presence. Micro Update will complete a competitor analysis COMPLETELY FREE as part of our web creation process. Continue reading “How to beat your Competitors with a Web Competitor Analysis” »

1 Star2 Stars3 Stars4 Stars5 Stars (2 votes, average: 5.00 out of 5)
Loading...

How to predict the TRAFFIC/HITS you will get to your website

By

How to predict website traffic to your site

Hopefully everyone knows that ranking in #1 on Google gets a LOT OF TRAFFIC and CLICKS. This guy has written a great article that shows you how we get this data and then use it. Continue reading “How to predict the TRAFFIC/HITS you will get to your website” »

1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading...

Free Competitor Analysis
Get your free website competitor analysis!

Follow Micro Update

Subscribe by Email

Enter your email address:

Delivered by FeedBurner

Micro Update
We provide Web Design, SEO, Social Networking and Mobile Application development services to SME business in the South West, Devon.
Scroll to top