data-analysis

问题 names Class Category label ram A Red one ravi A Red two gopal B Green three Sri C Red four my_list1=["Category"] my_list2=["Class"] I need to get the combination counts between these two columns. I am trying to get the combination of some selected columns. my_list2 even have more than one. I tried, df[mylist1].value_counts() It is working fine for a sinigle column. But I want to do for multiple column in my_list2 based on my_list1 My desired output should be, output_df, Value Counts Red.A 2

问题 I have a multiline file with text having no spaces. Thereisacat;whichisverycute.Thereisadog;whichisverycute. Thereisacat;whichisverycute.Thereisadog;whichisverycute. I want to extract string between cat and cute (first occurrence not second) that is the output is ;whichisvery ;whichisvery I am close to getting it but I end up getting string from cat to the last cute with the command from here. sed -e 's/.*cat\(.*\)cute.*/\1/' I am getting ;whichisverycute.Thereisadog;whichisvery

问题 I have some data that I want to group by on multiple columns, perform an aggregation function on, and then transpose into different columns using Hive. For example, given this input Input: hr type value 01 a 10 01 b 20 01 c 50 01 a 30 02 c 10 02 b 90 02 a 80 I want to produce this output: Output: hr a_avg b_avg c_avg 01 20 20 50 02 80 90 10 Where there is one distinct column for each distinct type in my input. a_avg corresponds to the average a value for each hour. How can I do this in Hive?

问题 I have a text file which was converted to dataframe using below command: df = pd.read_csv("C:\\Users\\Sriram\\Desktop\\New folder (4)\\aclImdb\\test\\result.txt", sep = '\t', names=['reviews','polarity']) Here the reviews column consists of all the movie reviews and polarity column consists of whether the review is positive or negative. I have below feature function, to which my reviews column (nearly 1000 reviews) from dataframe needs to be passed. def find_features(document): words = word

问题 I'm new in PyTables and I want to retrieve a dataset from a HDF5 using natural naming but I'm getting this error using this input: f = tables.open_file("filename.h5", "r") f.root.group-1.dataset-1.read() group / does not have a child named group and if I try: f.root.group\-1.dataset\-1.read() group / does not have a child named group unexpected character after line continuation character I can't change names in the groups because is big data from an experiment. 回答1: You can't use the minus

问题 I have two dataframes, df1, Values 0 Sri 1 pyd 2 NaN 3 sri, is 4 keyboard 5 kumar,cricketer df2, Values | Names Sri | Sri is a good player NaN | NaN sri, is | Sri is a good player kumar,cricketer | Kumar is a cricketer I am trying to update the df1 by comparing df1 and df2. df1["Values"] will have df2["Values"] and more. if a value present in df1 and df2 then I want to map the corresponding df2["Names"] in df1["Names"] my desired output is df1, Values | Names 0 Sri | Sri is a good player 1

问题 In my work, we have a variety of large tables storing data used for a set of multidimensional nonparametric models. Each table is a float array with a size of typically 200,000 to 5,000,000 elements. Today, I was going about a normally trivial update to this codebase, updating a set of the lookup tables, when I found the compiling and linking of the project was resulting in a Microsoft Incremental Linker has Stopped Working , something I had not seen before. Note that the tables I was

问题 I hava a df, A B one six two seven three level five one and a dictioinary my_dict={1:"one,two",2:"three,four"} I want to replace df.A with my_dict keys() my desired output is, A B 1 six 1 seven 2 level five one I tried df.A.replace(my_dict,regex=True) but goes wrong pls help, thanks in advance! 回答1: You need dict comprehension for separate each values to keys first: my_dict={1:"one,two",2:"three,four"} d = {k: oldk for oldk, oldv in my_dict.items() for k in oldv.split(',')} print (d) {'one':

问题 I'm trying to analyze a large data set for listings on Airbnb and in the amenities column, it lists out the amenities that the listing has. For example, {"Wireless Internet","Air conditioning",Kitchen,Heating,"Fire extinguisher",Essentials,Shampoo,Hangers} and {TV,"Wireless Internet","Air conditioning",Kitchen,"Elevator in building",Heating,"Suitable for events","Smoke detector","Carbon monoxide detector","First aid kit",Essentials,Shampoo,"Lock on bedroom door",Hangers,"Hair dryer",Iron,

问题 I have a homework assignment where I need to take a CSV file based around population data around the United States and do some data analysis on the data inside. I need to find the data that exists for my state and for starters run a Linear Regression Analysis to predict the size of the population. I've been studying R for a few weeks now, went through a LinkedIn Learning training, as well as 2 different trainings on pluralsight about R. I have also tried searching for how to do a Linear