Question: nsFilter() almost always return the same number of filtered genes in different microarrays
gravatar for arronar
12 months ago by
arronar150 wrote:


I'm about to process around 6 different microarray datasets and currently I'm working on the filtering step by using the nsFilter() function from geneFilter library.

After running the raw data through the RMA algorithm, I'm using the following code with a custom function in order to remove the filtered genes.

frma.filtered <- nsFilter(, require.entrez=FALSE, remove.dupEntrez=FALSE) = remove.filtered.genes(, )

remove.filtered.genes <- function( , ){

  for ( i in 1:nrow( ){

    index = which(row.names( == row.names([i] )

    if( length(index) == 1 ) =[-index, ]
      print( paste("[Err] Problem with ", row.names([i] , " it's exists more than one time in the original (non filtered) data", sep="") )

The thing now is that I realized that for the 5 out of 6 datasets, the result of the frma.filtered$filter.log is the same.

[1] 27307

[1] 62

Is this something expected that depends on microarray chip or is a fault/miss-usage of mine?

Thank you.

ADD COMMENTlink modified 12 months ago by Kevin Blighe35k • written 12 months ago by arronar150
gravatar for Kevin Blighe
12 months ago by
Kevin Blighe35k
Republic of Ireland
Kevin Blighe35k wrote:

The nsFilter() function will decide which transcripts to remove by looking at all samples together. So, you should just have a single list of genes that were removed for each failed QC flag.

I have not used nsFilter, ever, in the past and prefer to manage my own QC of microarrays (old fashioned); however, I'm not alone in my skepticism of this function: Question: Filtering array data with nsFilter


ADD COMMENTlink written 12 months ago by Kevin Blighe35k

Thank you very much for your answer. Do you think that the following approach is better ?

f1 <- pOverA(0.25, log2(100))
f2 <- function(x) (IQR(x) > 0.5)
ff <- filterfun(f1, f2)
selected <- genefilter(eset, ff)
esetSub <- eset[selected, ]
ADD REPLYlink written 12 months ago by arronar150

To answer that, I will ask you a question: why do you feel the need to apply these filters to your data? The main microarray data processing algorithm, i.e., RMA normalisation, is designed to deal with virtually all issues related to data distribution and background noise. Are you noticing further issue with your data post normalisation?

ADD REPLYlink written 12 months ago by Kevin Blighe35k
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1644 users visited in the last hour