Issue Details (XML | Word | Printable)

Key: SFOS-1089
Type: Improvement Improvement
Status: Resolved Resolved
Resolution: Fixed
Priority: Minor Minor
Assignee: Steve Loughran
Reporter: Steve Loughran
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
SmartFrog

Better diagnostics of why a Hadoop filesystem won't load

Created: 28/Jan/09 02:47 PM (GMT)   Updated: 28/Jan/09 02:49 PM (GMT)
Component/s: _service_hadoop
Affects Version/s: 3.17.010
Fix Version/s: 3.17.010

Time Tracking:
Not Specified

Compatibility: backwards compatible


 Description  « Hide
If a URI doesnt turn into a loadable hadoop filesystem, it could be because
-the uri is bad
-the configuration file doesnt have a mapping to a classname
-the class won't load

there is not enough detail in Hadoop's own methods to determine this cause; do more ourselves.

 All   Comments   Work Log   Change History      Sort Order: Ascending order - Click to sort in descending order
Steve Loughran added a comment - 28/Jan/09 02:48 PM (GMT)
Before:
Termination Record: HOST morzine.hpl.hp.com:rootProcess:testJobSubmissionForked:tests:waitForJobTracker:else, type: abnormal, description: WaitForFilesystem or JobTracker Live failed ClusterStatusCondition testSFHadoopException:: File system will not load java.io.IOException: No FileSystem for scheme: hdfs, cause: java.io.IOException: No FileSystem for scheme: hdfs, SmartFrog 3.17.005dev (2009-01-28 12:33:57 GMT), primSFCompleteName: HOST morzine.hpl.hp.com:rootProcess:testJobSubmissionForked:tests:waitForJobTracker:condition, primContext: included
at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315)
at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338)
at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439)

Steve Loughran added a comment - 28/Jan/09 02:48 PM (GMT)
After:
Termination Record: HOST morzine.hpl.hp.com:rootProcess:testJobSubmissionForked:tests:waitForJobTracker:else, type: abnormal, description: WaitForFilesystem or JobTracker Live failed ClusterStatusCondition testSFHadoopException:: File system hdfs://localhost/tmp/hadoop/mapred/system will not load - no configuration mapping for fs.hdfs.impl, SmartFrog 3.17.005dev (2009-01-28 12:33:57 GMT), primSFCompleteName: HOST morzine.hpl.hp.com:rootProcess:testJobSubmissionForked:tests:waitForJobTracker:condition, primContext: included
at org.smartfrog.test.DeployingTestBase.completeTestDeployment(DeployingTestBase.java:315)
at org.smartfrog.test.DeployingTestBase.runTestsToCompletion(DeployingTestBase.java:338)
at org.smartfrog.test.DeployingTestBase.expectSuccessfulTestRunOrSkip(DeployingTestBase.java:439)


-Now the problem can be shown as being in the configuration

Steve Loughran added a comment - 28/Jan/09 02:49 PM (GMT)
added more diagnostics