How to import huge .csv files in R studio?
4
0
Entering edit mode
8.1 years ago
1769mkc ★ 1.2k

I want to import an expression .csv file in R studio ,but the size limit is 5 mb max my file is 30 mb how do I do that?

The file is mrna seq data from TCGA which I want to extract.How can I do that is there any way to import the huge file and see ?

R RNA-Seq • 38k views
ADD COMMENT
0
Entering edit mode

I think you may use ff lib

library(ff)

your_data <- read.csv.ffdf(file = 'your_file.csv', header = T)

other solution use bigmemory

the authors successfully load a CSV with size as large as 11GB

more details and other solution could be found here

ADD REPLY
8
Entering edit mode
8.1 years ago

fread() from data.table package is blazing fast for reading large files. It tries to guess the delimiter and header automatically. It will give you an object of class "data.table", which is very similar to data.frame though quirky sometimes. You can easily convert it to your familiar data.frame by using as.data.frame(x) or by using data.table=FALSE in the argument of fread().

ADD COMMENT
6
Entering edit mode
8.1 years ago

Try using read.csv() rather than clicking on files. The limitation is there to prevent you from trying to edit large files, which will degrade performance significantly.

ADD COMMENT
4
Entering edit mode
8.1 years ago
sm30 ▴ 40

CRAN pakage TCGA2STAT can be used to directly import TCGA data into R.

ADD COMMENT
0
Entering edit mode

yes finally I used that library

ADD REPLY

Login before adding your answer.

Traffic: 1778 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6