Difference between revisions of "Rate import from CSV"

From Kolmisoft Wiki
Jump to navigationJump to search
Line 31: Line 31:
= Description =
= Description =


It is very tedious work to add several thousands rates by hand so you can import them from CSV file.
It is very tedious work to add several thousand rates by hand, so you can import them from a CSV file.


There are 7 steps for importing rates from CSV file:
There are seven steps for importing rates from a CSV file:


# File upload
# File upload
Line 43: Line 43:
# Creating new rates
# Creating new rates


We will cover each of them one by one.
We will cover each of these one by one.


'''IMPORTANT NOTE: When importing - prefixes should be in E.164 format!!! E.g. no international prefixes!'''
'''IMPORTANT NOTE: When importing, prefixes should be in E.164 format!!! For example, no international prefixes!'''




Line 53: Line 53:
Select [[Image:excel.png]] '''Import from CSV''' for the Tariff you want to import rates.
Select [[Image:excel.png]] '''Import from CSV''' for the Tariff you want to import rates.


Then press on '''Browse''' and select CSV file with rates. Press '''Upload file''':
Then click on '''Browse''' and select CSV file with rates. Click '''Upload file''':


[[Image:rateimportfromcsv1.png]]
[[Image:rateimportfromcsv1.png]]
Line 61: Line 61:
== 2. Column assignment ==
== 2. Column assignment ==


File is uploaded and 5 first line of this file is available to check:
The file is uploaded and the first five lines of the file are available to check:


[[Image:rateimportfromcsv2.png]]
[[Image:rateimportfromcsv2.png]]


This helps us in next step, to assign CSV file‟s columns to MOR‟s variables. We have following window:
This helps us in the next step, to assign CSV file's columns to MOR's variables. We have the following window:


[[Image:rateimportfromcsv3.png]]
[[Image:rateimportfromcsv3.png]]


Here we must to assign columns from CSV file. '''Prefix''' and '''Rate''' are mandatory fields. All other fields can be empty.
Here we must assign columns from the CSV file. '''Prefix''' and '''Rate''' are mandatory fields. All other fields can be empty.
'''
'''
Connection Fee''', '''Increment''' and '''Min. Time''' have their defaults, if you want, you can enter manually values for them. Manually entered values have highest priority. If you omit them, then MOR insert values from CSV file, if there‟re no assigned column for these fields, then default values will be added to database (DB).
Connection Fee''', '''Increment''' and '''Min. Time''' have their defaults. If you wish, you can enter values manually for them. Manually entered values have the highest priority. If you omit them, then MOR inserts values from the CSV file. If there is no assigned column for these fields, then default values will be added to database (DB).


There are group of values under name '''USA specifics'''. These are only for USA/Canada. Users from these countries need to use these fields with their CSV files.
There are a group of values under the name '''USA specifics'''. These are only for USA/Canada. Users from these countries need to use these fields with their CSV files.


In the following example we selected fields which match our CSV file. Also entered some manual values for '''Increment''' and '''Min.Time'''. We will count time by 30s increments and minimum time for the call will be 60s with these settings:
In the following example, we select fields which match our CSV file. Also entered are some manual values for '''Increment''' and '''Min.Time'''. We count time by 30s increments and minimum time for the call is 60s, with these settings:


[[Image:rateimportfromcsv4.png]]
[[Image:rateimportfromcsv4.png]]


Such way of selecting CSV rows and assigning them to MOR values lets us import various CSV file formats.
This way of selecting CSV rows and assigning them to MOR values lets us import various CSV file formats.




Line 88: Line 88:
It is possible to select to which Day Type rates apply before importing them.
It is possible to select to which Day Type rates apply before importing them.


So in 2 steps it is possible to import separate rates for Work Days and Free Days or in 1 step - for All Days at once.
So in two steps it is possible to import separate rates for Work Days and Free Days, or (in a single step) to import rates for All Days at once.


[[Image:rate_day_type.png]]
[[Image:rate_day_type.png]]
Line 94: Line 94:
== 3. Column confirmation ==
== 3. Column confirmation ==


Next step is to review our selection and confirm if everything is correct. We can go Back or forward to the next step:
The next step is to review our selection and confirm that everything is correct. We can go Back or forward to the next step:


[[Image:rateimportfromcsv5.png]]
[[Image:rateimportfromcsv5.png]]
Line 102: Line 102:
== 4. Analysis ==
== 4. Analysis ==


It will take some time to accomplish this step. Now MOR is checking a lot of things from DB and CSV files: comparing rates, searching for duplicates, fixing small errors and so on. We get something like this after analysis is completed:
It will take some time to accomplish this step. MOR checks many things from DB and CSV files: it compares rates, searches for duplicates, fixes small errors and so on. After the analysis is completed, we get something like this :


[[Image:rateimportfromcsv6.png]]
[[Image:rateimportfromcsv6.png]]


The most interesting line is '''3 bad destination(s)'''. We press on the List to check them. In the new window we can see which destinations are bad and we can decide what to do with them. Possible that there are no directions for them, MOR cannot know to which country to assign this destination or maybe these destinations have duplicates in CSV file? You have to fix this if you want to import whole file. Here you can stop and fix your CSV file or you can ignore these errors and continue.
The most interesting line is '''3 bad destination(s)'''. We click on the List to check them. In the new window, we can see which destinations are bad and we can decide what to do with them. Is it possible that there are no directions for them, MOR doesn't know to which country to assign this destination, or maybe these destinations have duplicates in CSV file? You have to fix this if you want to import the whole file. Here you can stop and fix your CSV file, or you can ignore these errors and continue.


We will continue due to demo purposes pressing on '''Proceed'''.
We continue the demo by clicking '''Proceed'''.


Following steps are separated to divide big processing power if rate file is huge. It allows browser not to crash and successfully import 160.000+ destinations from one CSV file. (Tested).
The following steps are separated to avoid excessive demands on processing power if a rate file is huge. This keeps the browser from crashing and allows it to successfully import 160.000+ destinations from one CSV file (this has been tested).


== 5. Creating destinations ==
== 5. Creating destinations ==


MOR creates new destinations here. These destinations are necessary for the rates which will be added in step 7. This window is just informative, no decisions here:
MOR creates new destinations here. These destinations are necessary for the rates, which will be added in step 7. This window is just informative, no decisions here:


MOR creates only Destinations for prefixes which are not in MORs DB yet _AND_ if it is possible to find out the Direction (Country) fro these new prefixes (Destinations).
MOR creates only Destinations for prefixes which are not yet in MOR's DB and determines whether it is possible to find out the Direction (Country) for these new prefixes (Destinations).


It is possible in 2 ways:
This may be done in two ways:


1. System checks available prefixes for best match and selects found Direction as basis for new prefix (Destination).
1. The system checks the available prefixes for the best match and selects found Direction as a basis for the new prefix (Destination).


Example: if you try to import rate for prefix 370630 and this prefix is unknown for MOR, MOR checks longest matching prefix - 3706 for this case and founds out that it is Lithuania MOB, so it will create new Destination with Prefix 370630 which Direction will be Lithuania and subcode MOB (mobile network).
For example: if you try to import the rate for prefix 370630 and this prefix is unknown to MOR, MOR checks the longest matching prefix - 3706 in this case - and finds out that it is Lithuania MOB. So it creates a new Destination with Prefix 370630 in which the Direction will be Lithuania and the subcode MOB (mobile network).


2. If Country code is available in imported file, MOR assigns such Direction to newly created Destination.
2. If Country code is available in the imported file, MOR assigns this Direction to the newly created Destination.


Example: if again you try to import 370630 and it is unknown to MOR but in same CSV line for Country Code field you have LTU, MOR will create such Destination with Direction = Lithuania.
For example: if again you try to import 370630 and it is unknown to MOR, but you have LTU in same CSV line for Country Code field, MOR will create such a Destination with Direction = Lithuania.




Line 133: Line 133:
== 6. Updating rates ==
== 6. Updating rates ==


Here MOR updates rates with the values from CSV files. These rates already exist in DB. Just press '''Proceed''':
Here MOR updates rates with the values from CSV files. These rates already exist in DB. Just click '''Proceed''':


[[Image:rateimportfromcsv8.png]]
[[Image:rateimportfromcsv8.png]]
Line 141: Line 141:
== 7. Creating new rates ==
== 7. Creating new rates ==


Finally MOR creates all rates and we are all done!
Finally, MOR creates all rates and we are all done!


[[Image:rateimportfromcsv9.png]]
[[Image:rateimportfromcsv9.png]]
Line 148: Line 148:
== NOTES ==
== NOTES ==


Rate import is _VERY_ CPU intensive task.
Rate import is _VERY_ CPU-intensive task.


If there are a lot of rates please be patient and let MOR finish its job. Sometimes it gets some time to count everything and come back to life.  
If there are a lot of rates, please be patient and let MOR finish its job. It may take some time to count everything and come back to life.  


At the moments it could seem that browser is not responding – that is not true – it just works very hard importing your very own rates from CSV file.  
At some point it may seem that browser is not responding. That is not the case – it is just working very hard, importing your very own rates from the CSV file.  


If you get timeout error try to import file in smaller pieces.
If you get a timeout error, try to import the file in smaller pieces.


= Destination to create from CSV =
= Destination to create from CSV =

Revision as of 11:50, 4 May 2010

File format

File should be CSV (comma separated values).

Necessary fields in CSV line:

  • Prefix
  • Price

No other fields are necessary.

First line can be header.

Value Separator and Decimal Separator MUST be set correctly in SETTINGS - Setup - Settings - Functionality:

  • CSV Column Separator
  • CSV Decimal Separator

File and CSV separator settings should match. If they do not, you will get errors when trying to import file.

Where can I get an example file with available prefixes?

Go to SETTINGS - Billing - Tariffs and click on Icon excel.png Destinations CSV.




Description

It is very tedious work to add several thousand rates by hand, so you can import them from a CSV file.

There are seven steps for importing rates from a CSV file:

  1. File upload
  2. Column assignment
  3. Column confirmation
  4. Analysis
  5. Creating destinations
  6. Updating rates
  7. Creating new rates

We will cover each of these one by one.

IMPORTANT NOTE: When importing, prefixes should be in E.164 format!!! For example, no international prefixes!


1. File upload

Select Excel.png Import from CSV for the Tariff you want to import rates.

Then click on Browse and select CSV file with rates. Click Upload file:

Rateimportfromcsv1.png


2. Column assignment

The file is uploaded and the first five lines of the file are available to check:

Rateimportfromcsv2.png

This helps us in the next step, to assign CSV file's columns to MOR's variables. We have the following window:

Rateimportfromcsv3.png

Here we must assign columns from the CSV file. Prefix and Rate are mandatory fields. All other fields can be empty. Connection Fee, Increment and Min. Time have their defaults. If you wish, you can enter values manually for them. Manually entered values have the highest priority. If you omit them, then MOR inserts values from the CSV file. If there is no assigned column for these fields, then default values will be added to database (DB).

There are a group of values under the name USA specifics. These are only for USA/Canada. Users from these countries need to use these fields with their CSV files.

In the following example, we select fields which match our CSV file. Also entered are some manual values for Increment and Min.Time. We count time by 30s increments and minimum time for the call is 60s, with these settings:

Rateimportfromcsv4.png

This way of selecting CSV rows and assigning them to MOR values lets us import various CSV file formats.


Rate Day Type

This option is available starting from MOR 9

It is possible to select to which Day Type rates apply before importing them.

So in two steps it is possible to import separate rates for Work Days and Free Days, or (in a single step) to import rates for All Days at once.

Rate day type.png

3. Column confirmation

The next step is to review our selection and confirm that everything is correct. We can go Back or forward to the next step:

Rateimportfromcsv5.png


4. Analysis

It will take some time to accomplish this step. MOR checks many things from DB and CSV files: it compares rates, searches for duplicates, fixes small errors and so on. After the analysis is completed, we get something like this :

Rateimportfromcsv6.png

The most interesting line is 3 bad destination(s). We click on the List to check them. In the new window, we can see which destinations are bad and we can decide what to do with them. Is it possible that there are no directions for them, MOR doesn't know to which country to assign this destination, or maybe these destinations have duplicates in CSV file? You have to fix this if you want to import the whole file. Here you can stop and fix your CSV file, or you can ignore these errors and continue.

We continue the demo by clicking Proceed.

The following steps are separated to avoid excessive demands on processing power if a rate file is huge. This keeps the browser from crashing and allows it to successfully import 160.000+ destinations from one CSV file (this has been tested).

5. Creating destinations

MOR creates new destinations here. These destinations are necessary for the rates, which will be added in step 7. This window is just informative, no decisions here:

MOR creates only Destinations for prefixes which are not yet in MOR's DB and determines whether it is possible to find out the Direction (Country) for these new prefixes (Destinations).

This may be done in two ways:

1. The system checks the available prefixes for the best match and selects found Direction as a basis for the new prefix (Destination).

For example: if you try to import the rate for prefix 370630 and this prefix is unknown to MOR, MOR checks the longest matching prefix - 3706 in this case - and finds out that it is Lithuania MOB. So it creates a new Destination with Prefix 370630 in which the Direction will be Lithuania and the subcode MOB (mobile network).

2. If Country code is available in the imported file, MOR assigns this Direction to the newly created Destination.

For example: if again you try to import 370630 and it is unknown to MOR, but you have LTU in same CSV line for Country Code field, MOR will create such a Destination with Direction = Lithuania.


Rateimportfromcsv7.png

6. Updating rates

Here MOR updates rates with the values from CSV files. These rates already exist in DB. Just click Proceed:

Rateimportfromcsv8.png


7. Creating new rates

Finally, MOR creates all rates and we are all done!

Rateimportfromcsv9.png


NOTES

Rate import is _VERY_ CPU-intensive task.

If there are a lot of rates, please be patient and let MOR finish its job. It may take some time to count everything and come back to life.

At some point it may seem that browser is not responding. That is not the case – it is just working very hard, importing your very own rates from the CSV file.

If you get a timeout error, try to import the file in smaller pieces.

Destination to create from CSV

When importing rates from CSV file now you can check which Destinations will be created automatically.

You can view them in separate window when you press List in step 4 in field Destinations to create.

Such destinations do not exist in MOR database and MOR will create them when importing rate file.

More info: Integrity Check

Example Videos

<flashow>http://wiki.kolmisoft.com/videos/rates_import_from_csv.swf%7Cwidth=600%7Cheight=455</flashow>


Similar video with different tariff:

<flashow>http://wiki.kolmisoft.com/videos/tariff_import_from_csv.swf%7Cwidth=800%7Cheight=618</flashow>


See also