PANDAS: int32 overflow? Can't bulid a pivot table

Question

I use the pd.pivot_table() method to create a user-item matrix by pivoting the user-item activity data. However, the dataframe is so large that I got compla

Answer 1

Some Solutions:

• You can downgrade your pandas version to 0.21 which is no problem with pivot table with big size datas.
• You can set your data to dictionary format like df.groupby('EVENT_ID')['DIAGNOSIS'].apply(list).to_dict()