I have a question regarding database management. I would be really grateful if somebody here can help me. I have a table with 100,000 columns and 30,000 rows that I would like to store it in a back end database like SQLite or mySQL. The problem is that programs like SQLite have a limitation regarding the number of columns and rows that can be stored in a data base. For instance, SQLite only stores data in database if the number of columns doesn't exceed 2000 columns whereas in my own data set I have way more columns. My question is how I can store my data in a database in the most efficient way?
Take into account that I do not have any redundancy in my table. In my table the rows are genes and columns are single cells and each element in the table represents the normalized value of gene expression.
Thank you in advance for your help.