Question: nsFilter() almost always return the same number of filtered genes in different microarrays
gravatar for arronar
21 months ago by
arronar200 wrote:


I'm about to process around 6 different microarray datasets and currently I'm working on the filtering step by using the nsFilter() function from geneFilter library.

After running the raw data through the RMA algorithm, I'm using the following code with a custom function in order to remove the filtered genes.

frma.filtered <- nsFilter(, require.entrez=FALSE, remove.dupEntrez=FALSE) = remove.filtered.genes(, )

remove.filtered.genes <- function( , ){

  for ( i in 1:nrow( ){

    index = which(row.names( == row.names([i] )

    if( length(index) == 1 ) =[-index, ]
      print( paste("[Err] Problem with ", row.names([i] , " it's exists more than one time in the original (non filtered) data", sep="") )

The thing now is that I realized that for the 5 out of 6 datasets, the result of the frma.filtered$filter.log is the same.

[1] 27307

[1] 62

Is this something expected that depends on microarray chip or is a fault/miss-usage of mine?

Thank you.

ADD COMMENTlink modified 21 months ago by Kevin Blighe50k • written 21 months ago by arronar200
gravatar for Kevin Blighe
21 months ago by
Kevin Blighe50k
Kevin Blighe50k wrote:

The nsFilter() function will decide which transcripts to remove by looking at all samples together. So, you should just have a single list of genes that were removed for each failed QC flag.

I have not used nsFilter, ever, in the past and prefer to manage my own QC of microarrays (old fashioned); however, I'm not alone in my skepticism of this function: Question: Filtering array data with nsFilter


ADD COMMENTlink written 21 months ago by Kevin Blighe50k

Thank you very much for your answer. Do you think that the following approach is better ?

f1 <- pOverA(0.25, log2(100))
f2 <- function(x) (IQR(x) > 0.5)
ff <- filterfun(f1, f2)
selected <- genefilter(eset, ff)
esetSub <- eset[selected, ]
ADD REPLYlink written 21 months ago by arronar200

To answer that, I will ask you a question: why do you feel the need to apply these filters to your data? The main microarray data processing algorithm, i.e., RMA normalisation, is designed to deal with virtually all issues related to data distribution and background noise. Are you noticing further issue with your data post normalisation?

ADD REPLYlink written 21 months ago by Kevin Blighe50k
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1365 users visited in the last hour