Hello

 

Currently working on a project to allow researchers to upload data files 
into a repository. The system will only handle the import, validation and 
transformation of the data, so that it meets the required standards. When a 
file is upload the for the first time the user has to be able to define the 
structure of the destination based on the csv/xls. This includes key field, 
data types, foreign keys etc. There is no requirement for the data to be 
displayed or edited once in the repository by this system, currently. We 
are currently planning on using PostgreSQL as the database.

 

Our organisation already has another system, with a similar requirement, 
that is partially written by an external contractor in Ruby on Rails. The 
dynamic creation of the tables is no problem but it is the dynamic creation 
of the models and controllers that is proving difficult and is the reason 
why this other project is not finished. 

 

Reading through the forums it looks like Django may offer a better solution 
through meta-programming. https://code.djangoproject.com/wiki/DynamicModels 
This does look like quite an old article though. 

 

The other solution would be to have one table that holds all the records 
for all the imported files and have a JSONB (in PostgreSQL) to hold the 
columns that differ between files. This means that we would not be able to 
represent the relationships between files though. Ideally the organisation 
would like the data in a relational form to make subsequent analysis with 
other tools easier.

 

Above all it is important that the system is robust and maintainable. Any 
solution will of course be tested by creating a proof of concept first.

 

Is it still possible to dynamically create the models in the latest 
versions of Django (1.11 and 2.02)? 

 

Thank you

Marc

-- 
You received this message because you are subscribed to the Google Groups 
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at https://groups.google.com/group/django-users.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-users/d707e803-3dbf-43e6-95a8-13869043c280%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to