Hadoop Notes

  

Error while starting map reduce job



Error Stack :


Running job: job_201204031541_0033

12/04/09 09:28:06 INFO mapred.JobClient:  map 0% reduce 0%

12/04/09 09:28:09 INFO mapred.JobClient: Task Id : attempt_201204031541_0033_m_000003_0, Status : FAILED

java.lang.Throwable: Child Error

        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242)

Caused by: java.io.IOException: Task process exit with nonzero status of 1.

        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)

 

12/04/09 09:28:09 WARN mapred.JobClient: Error reading task outputhttp:...


Resolution:

* log directory problem

http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-user/201107.mbox/%3CCABTmYdbAhzvF8DgJKxHFfobirdQRR-jBgTKMryg4VxxM+aHr=Q@mail.gmail.com%3E

 


* userlogs problem

https://issues.apache.org/jira/browse/MAPREDUCE-2592
 

* inode limit 32000 in ext3

http://stackoverflow.com/questions/2091287/error-in-hadoop-mapreduce
 

* cleaning up tasklogs has been improved in 0.22.0