Value Extraction Guidelines

Q&A Non-DQ Courses
#1

Hello guys,
I’m a Python newbie and would like some advice on how to tackle a problem :slight_smile:

  • I have a large text file (3GB);
  • With one JSON per line;
  • I need to extract a value from each line.

I would like to know which tools do you recommend me to use, and some guidelines on the best way to do that.

Thanks a lot for the help :smiley:

1 Like
#2

Hello.

You can use the pandas.read_json function to read your file into a DataFrame, and then all the values you need will be a column of this frame. The below link show how to approach that.

https://datatofish.com/load-json-pandas-dataframe/

I hope this helps you. If you need further information, do not hesitate to ask.

1 Like