I’m trying to import a tab delimited file of 430,000 records into Servoy/Firebird, but I am not having a great deal of success.
Is there a limitation on the number of records that can be imported in one go?
at what stage is is going bad?
how does it go bad?
what kind of import? Excel?
After matching the fields, click next, and the dialogue says importing, and after an hour, hasn’t finished.
Click finish. Exit. Go backing to the solution, only to find that there are only 2,175 records.
The file is a tab delimted text file of 100,00 records, exported from FilemakerPro. i have tried with a tab delimted text file exported from Access, same results.
Also tried above with file of 450,00 records, but I can’t get to the match fields dialogue.
with youre first problem we should give a better indication where it is now.
The second problem is know. We have to change our code for that so that we don’t try to load the file at onces…
both on my list..
I have not got any further with this. To summarize:
I have a file of 450,000 records (Tab delimited text file). When I try and import that file, I can’t get past the ‘Browse’ for file dialogue, i.e. I select the file, click ‘Next’ and then nothing happens, Servoy doesn’t take me to the match fields dialogue.
To try and overcome this problem, I tried reducing the file size down to 100,000 records. This time I got to the match fields dialogue, however, after clicking ‘Next’ to import the file, Servoy tells me that it is importing the file, but doesn’t go any further, i.e. it doesn’t finish the import.
Because of the inability of Servoy to conduct an import, I am having to consider changing to MySQL and use a MySQL utility to import data. I am surprised that Servoy is unable to import volumes of data, surely this is a fairly basic function of any Server Application.
it is not our core.. because importing data is a database thing.. So using database tools for that is most of the time much faster (and most of the time also easier because the tools is made for the database)
but we will improve our plugins as good we can..
I take your point, but given that Servoy is being positioned, amongst other things, as a natural progression from FilemakerPro, most users I would suspect would expect similar functionality. If FilemakerPro can do it, why can’t Servoy. Secondly, as there is a an import function within Servoy, one would expect it to work.
If I continued with Firebird, what utility would you suggest I use. I should point out that the application that I am building will require 5 files to be imported as an initial load, ranging from 450,000 records to 600,000 records. Thereafter, we will need to import 5 files each month, each of which will contain approx. 20,000 records.
Also, do you have an ETA for the Servoy version that will include iAnywhere?
i changed the import plugin so that it will not generate a out of mem anymore.. It will handly now any record size you want. Only again i have to say that importing that amount (400.000) will not work through the import plugin because it is purely ment for a client side import for a few records (a couple of 1000).
100.000+ (or whatever number) must be handled with a serverside import, So a directly into the database.
it is not yet final/known when sybase will be included.