Twitter Crawler for Wordpress

Getting Started


We thank you for your business and hope you enjoy the fruits of our labor. Our products are not only developed by us but are also used in all of our projects so you can rest assured we test our products thoroughly under various conditions to ensure you receive a quality product. If however your environment experiences any type of issue with our products please feel free to visit our forum or email us at

Thank you,
The Team

Are you ready to Automate your content creation?

In order to use this Plugin you will need to complete 5 simple steps

  • Install the Plugin
  • Create a Twitter app
  • Configure the Plugin with your Twitter app info
  • Add Twitter pages to crawl
  • Configure cronjobs to perform the Plugins tasks


  • Automatically Crawl Twitter and create content for your blog




Upload and Enable the Plugin


There are 2 methods for installing the wordpress module

  • Use the wordpress plugin Upload/install method in the administration section
  • Upload the Twitter_crawler folder to you wp-content/plugins folder

Method 1

  • Navigate to your admin add new plugin section
  • Click upload, locate the zip folder you downloaded for Twitter Crawler and upload the zipped folder
  • After Wordpress uploads and installs the plugin you can click on the link to activate it.
  • You will then see in your admin section the new Twitter Crawler section appear in the left admin navigation

Method 2
Upload the “twitter_crawler” folder to your

  • Connect to your websites FTP
  • Navigate to the folder wp-content/plugins
  • Upload the entire twitter_crawler folder and all of its contents into the modules folder. You should then see wp-content/plugins/Twitter_crawler in your ftp program


Enable the Plugin in your websites admin section

  • In the Wordpress admin section navigate to
  • Locate the Plugin named Twitter Crawler within the Plugins section and check the box to enable the Twitter Crawler Plugin
  • Click save to enable the Plugin

After installation is completed you should see a new tab in your Admin navigation bar called “Twitter Crawler”. If you do not see this just refresh the page to ensure the system is showing the most up to date version of your navigation bar

Create your twitter App

In order to use the Plugin you need to create a twitter app.

  • Visit
    and sign in (if you are not already signed into twitter
  • Click Create new App

Fill out the app name, description, your website URL and the callback url.
Note: for the Callback URL copy it from the Twitter Crawler config section. You can reach the Twitter Crawler Config Section via your site domain followed by

As an example

Congratulations you created a Twitter App

The resulting page will show the overview of your Twitter app with 4 tabs (Details, Settings, Keys   Access Tokens, Permissions). Click on Keys   Access Tokens as shown in the screenshot. You need to add these to the Twitter Crawler Plugins configuration.

Additionally, for the app to work, we need to obtain Access tokens for our Twitter App. This allows us to perform all our needed functions without having to log in or authenticate the app for our account. To do this go back to your Twitter apps Key & Access Tokens tab and scroll down. Click to generate the tokens so that you can later add them to the Twitter Crawler app config Access Tokens section.

Lastly we want to change the app permissions to ensure our script can perform all actions we need. on the site under your app, click on the permissions tab. Next click on the radio button for enable "Read, Write and Access direct messages " permissions.

Configure the Twitter Crawler Plugin

  • Visit Twitter Crawler configuration page

In your Admin navigation bar you click “Twitter Crawler” (the Plugin is also reachable via


  • Connect Twitter Crawler with twitter App

Under the settings tab of the Plugin enter in the Twitter App Key/Secret, the access tokens we generated and click Submit to save these settings

Lets Add Twitter Pages to Crawl :-)

  • Search

To setup a Twitter url to crawl you must find a Twitter page that provides content matching your theme. You can use google or Twitter to search for users who are posting information at you want to import into your blog as posts.

Simply copy a Twitter url into the "Twitter page Url" field and click "Save Changes". Do this for as many Twitter pages as you would like.

Once you see the Twitter page listed you can now work on the Twitter Crawler settings for this specific Twitter page. You can control what Twitter post type should be crawled (links, pictures, videos, text only posts, etc), What type of content type it should create on your website (blog, post, page, etc), what categroies it should be posted in on your website (uncategorized, blog, tech blog, etc) and finally what status theposts should have (preview, published, pending, draft, etc). Once you have completed configuring the settings for all of the Twitter pages you added click save changes. Now all Twitter pages will be crawled and the respective content will be created on your website.

Start your engines

Part 1: Setting up cron job to run the Twitter Page Crawler system

In order for the script to run we need to set up cronjobs. These are scheduled jobs that will call our script to run at designated times. For example every 15 minutes. We recommend running the cron every 15 minutes.

Depending on your technical skill you can achieve this through a number of methods. Either setting them up directly on your linux/windows server or using a 3rd party service.

We recommend using It is a free cron service that is reliable for achieving the needs of this Plugin.

Go to
to register and login

Once logged into click on the cronjobs tab at the top

Then click on Create cronjob

  • Enter a title for this cronjob. i.e. Run Twitter Follow Script
  • Enter the script url. You get this again from the Twitter Crawler Config tab on your website
  • Set a scheduled time for running this cron. i.e. every 1 minute, only on wednesdays, etc. (We recommend 15 minutes)
  • Click save and you are done.

This documentation is provided by