MyFxBots
Published on Wed Oct 16th, 2013

The available data in Dukascopy is raw in the form of files spanning only one hour, so it's obvious that tools will be needed to download and parse it. Before other methods to get the data were available, a series of scripts were useful to download Dukascopy free tick data, and they are still valid till now. PHP scripts are so simple, with non-commercial quality code, but working well.

These PHP scripts are available in the tick data downloads page.

  • There are 4 scripts
  • A script to download the Dukascopy data called "download_dukascopy_data.php". If you have files already downloaded on the hard disk, the script does not attempt to them, while it just requests the files not existing, to make this work successfully, dates in the $currencies array at the beginning of the script should be set to the date of the last download; as the standard Unix timestamps are used by Dukascopy (epoch date, which equals the number of seconds since 01.01.1970). To convert from a regular date to such a Unix timestamp with ease, Epoch Converter could help, a very easy to use online tool.
  • A script to process the downloaded data, assuming that it is present in the same directory as the last script where the data was downloaded too (process_dukascopy_data.php); this script needs some parameters, it doesn't need to be described or you can revise the next script.
  • A small shell script to process all the downloaded data with .bat extension for windows and .sh extension for Linux.

How to download and convert to CSV in windows

First you need to go to windows PHP download part and get the latest binary version zip file, then decompress it to c:\php\, then decompress other scripts downloaded from same directory too.

Rename c:\php\php.ini-development to c:\php\php.ini. If there is no file named php.ini-development in the folder, use php.ini-dist or any other php.ini-something file there.

  • Edit c:\php\php.ini;
  • Search for: ;extension=php_curl.dll
  • Remove the semicolon in front of the line
  • Add an "ext/" in front of "php_curl.dll"
  • Then, it should look like: extension=ext/php_curl.dll
  • Save the file and quit.

If a zip error occurred and an ext/php_zip.dll is in the PHP installation, repeat the last steps too for extension=ext/php_zip.dll.

  • Go to the 7-Zip download page, download the command line version, unpack it and put 7za.exe in the same directory (c:\php\).
  • Click "start->run".
  • Type: cmd
  • Click "ok" (in windows 7 / vista, type cmd then hit enter in "search programs and files" box of start menu).
  • In the command window type: cd \php
  • Type: php download_dukascopy_data.php

Relax, then wait, don't rush at all, this will take ages. The progress can be checked by exploring the currency pair directories till get filled. If any abnormal error occurs, repeat the process again after it's finished, it will just download missed files in the last run due to connection errors.

If just some of the available currency pairs are needed, the array present at the beginning of "download_dukascopy_data.php" file can be edited. The order currency pair download can be switched, or even a complete removal of the unwanted pairs is possible. The time to start to download of each pair is present next to it in the form of a Unix timestamp number, it's set to the earliest available date by default, it can be postponed to a later date by editing this number by the help of Epoch Converter.

  • After the download has completed, if the EURUSD data up to 01.01.2012 for instance are needed:
  • Type: php process_dukascopy_data.php EURUSD 200702 201201 EURUSD.csv
  • The output will be found in EURUSD.csv
  • Alternatively, you can type: process.bat

The later will batch process all the currency data. The error spam at this step can be safely ignored. Note: if process.bat or process.sh is involved, the ending dates in them may need to be updated first to get the full data range.

Now assuming that everything went fine, the CSV files should be now in the same c:\php folder and it's ok to proceed with preparing the tick data for MetaTrader 4.

Warning: Adequate disk space must be available. As by 2012, the downloaded tick files are over 20 GB in size, and by adding up the size of the resulted CSV files, the total size could exceed 100 GB.

Latest Tick Data Suite News and Updates

Current MetaTrader Platform Will Stop Working After May 1st, 2023 The traders using a version of MT4 older than build 1370 on Windows, their MetaTrader platform will stop working after May 1st, 2023. You should update your MT4 to the latest free version to ensure a seamless and uninterrupted trading experience. The latest MT4 build features improved platform stability and you can download it by following the instructions below:
MetaTrader 4 and 5 Applications Are Back in the Apple AppStore MetaTrader 4 and MetaTrader 5 Apps were reinstated on March 6th, 2023, and are now available on the AppStore. MetaQuotes has communicated with Apple regarding operational technicalities throughout the lengthy process of restoring the Apps back to the AppStore, providing further insights as needed.
MT4 and MT5 have been removed from Apple iOS AppStore Apple removes the widely used and most popular Forex Trading Apps; MetaTrader MT4 & MT5 from App Store MT4 & MT5 apps are no longer on the App Store globally.
Renko Bar Backtesting with Tick Data Suite and Other Great Features It is now possible to run backtests using Renko bars natively. This was previously possible only with the assistance of 3rd party software through a cumbersome process with a somewhat unfriendly learning curve; now it is available directly in the Tick Data Suite
Tick Data Suite Features and Details The Tick Data Suite is a Unique Product with which you can Download Tick Data, Do Backtesting and Optimization your Strategies using Variable Spread in Metatrader 4
Free Tick Data Download A lot of tick data sources are available online and this is an attempt to cover some of the most well and popular providers where tick data are free to download
Tick Data Suite Guide [OUTDATED] On arriving to this guide, it's assumed that you already downloaded the desired tick data and it was converted to an FXT file and several HST files, each of which is setting in its proper place. If the steps above were not done yet, you will need first to follow the How to download free tick data and the How to prepare the tick data for MetaTrader 4 guides
How to Download Dukascopy Tick Data and Purse it with Birt's PHP Scripts [Outdated] A Brief Guide On How To Download And Process The Free Forex Tick Data From Dukascopy Using Birt's PHP Scripts. The Available Data In Dukascopy Is Raw In The Form Of Files Spanning Only One Hour, So It's Obvious That Tools Will Be Needed To Download And Parse It
How to Download Dukascopy Tick Data with JForex Platform A Quick Guide on How to Download and Process the Free Forex Tick Data from Dukascopy using the JForex Platform
Download Birt's Free Tick Data Tools and Scripts [Outdated] Download Birt's Free Tool and Script Files Helping you to Acquire, Process and Use Free Tick Data in Metatrader 4 Backtesting
Problems with Conversion to FXT and Tick Data Usage in Tick Data Suite [Outdated] Problems and Issues with Strategy Backtesting in Metatrader 4 Using Tick Data Suite, from CVS Conversion to FXT to Tick Data Usage
Free Birt's Batch Script MT4 FXT Files 2GB Limit Removal [Outdated] Birt's Patch Script Removes the 2GB the Metatrader 4 Limitation with FXT Files and Disables Overwriting Existing FXT Files too, which Effectively Permits Pre-Created Tick Data FXT Files Usage.
Enabling and Verifying the Use of Prepared Tick Data by MT4 for Backtesting [OUTDATED] As the Latest Metatrader 4 Client Builds are Unable to use Custom FXT Files Anymore, a Special Software has to be Run to Enable it for that; Tick Data Suite, a Commercial (Paid) Software, or the Completely Free Birt's Patch Script with Some Limitations.
How to Prepare Tick Data FXT Files for MT4 Backtesting with CSV2FXT [OUTDATED] Native CSV File Containing Tick Data are Incompatible with Metatrader 4, so it Can't be Used in Backtesting. FXT is the Proprietary File Format that Contains Ticks and Can be Read by Metatrader 4, so Simply we Need to Convert CSV Files to FXT.
Tick Data Suite VS Free Birt's Batch [OUTDATED] In fact, the Tick Data Suite is a commercial alternative for the free Birt's patch script, so every fault or deficiency in the latter are addressed in the Tick Data Suite with full technical support to its clients

Talk about Tick Data Suite

Information, charts or examples contained in this review article are for illustration and educational purposes only. It should not be considered as an advice or endorsement to purchase or sell any security or financial instrument. We do not and cannot give any kind of financial advice. No employee or persons associated with us are registered or authorized to give financial advice. We do not trade on anyone's behalf, and we do not recommend any broker. On certain occasions, we have a material link to the product or service mentioned in the article. This may be in the form of compensation or remuneration.