Reading CSVs through pandas containing Japanese character in some columns.

When we use pandas.read_csv(encoding = "utf8") to read a csv which contains both English and Japanese character, it fails with the error, "UTF-8 codec can not decode byte..... "

Please use pandas.read_csv(encoding = "cp932") in this case. It works with a warning

Comments

Post a Comment

Popular posts from this blog

 I found a very strange anamoly of a code working on Jupyter notebook, but its not working on the app.python from a flask applicatoin. When the type of column names if int instead of string, the str.replace() code works on the jupyter notebook, but does not work in the flask python. Scenario: I have a dataframe having year-months(For example 202001, 202002 etc.) as the column name. Now I want to have a replace code, like, col = [ '201911', '201912','202001', '202002', '202003', '202004', '202005', '202006', '202007', '202008','202009','202010']  the below code works on the jupyter notebook, but fails on the flask. data_df[col] = data_df[col].replace(to_replace=['-',' ','\*'], value='', regex=True).astype(float)
Read more
Some Html Issues faced while working with Angular 2. Checkbox not getting selected on Screen. --------------------------------------------------          Soultion: Changed the z-index of checkbox and moved it to the front. Only one checkbox getting selected. --------------------------------------------------         Solution: Added a handler on the click, sent the event to the handler, and called event.stopPropagation() inside handler.
Read more
Feature of Scrolling in a page in RMarkdown Flexdashboard. ---------------------------------------------------------------------------------- I was using Flexdashboard with RMarkdown and faced an issue. When I was adding more rows, it used to squeeze the existing plots on the page and i was not getting the feature of scrolling automatically. I saw all the examples of Flexdashboard from the author, but every example had only 3-4 plots which fit in a single page. I search for some documentation but could not find one. Solution: We have to include a small key-value pair text, " vertical_layout: scroll" and it worked like magic and i had very nice scrolling feature on my page.
Read more