[Solved-1 Solution] How to Parse Complex JSON String in Pig ?
Json
- A common use of JSON is to exchange data to/from a web server.
- When sending data to a web server, the data has to be a string.
Problem:
How to Parse Complex JSON String in Pig ?
Solution 1:
- We using JsonTupleMap() in Mozilla's Akela library for pig. It accomplishes exactly what we want by parsing all of JSON even when it's complex.
Example:
REGISTER '/path/to/akela-0.5-SNAPSHOT.jar';
DEFINE JsonTupleMap com.mozilla.pig.eval.json.JsonTupleMap();
loaded = LOAD '$INPUT' AS (json_string:chararray, ...);
jsonified = FOREACH loaded GENERATE JsonTupleMap(json_string) AS json:map[], ...;
some_generate = FOREACH jsonified GENERATE json#'key'#'sub_key';