hue | 易学教程

Calculate difference between start_time and end_time in seconds from unix_time yyyy-MM-dd HH:mm:ss

阅读更多关于 Calculate difference between start_time and end_time in seconds from unix_time yyyy-MM-dd HH:mm:ss

问题 I'm still learning SQL and I found a couple of solutions on SQL Server or Postgreы, but it doesn't seen to work on HUE DATEDIFF , only allows me to calculate difference between days seconds, minutes are not available. Help is very welcome. I was able to split the timestamp with substring_index , but then I can't find the right approach to compare and subtract start_time to end_time in order to obtain the accurate account of seconds. I can't find time functions so I'm assuming I should

Running shell script from oozie through Hue

阅读更多关于 Running shell script from oozie through Hue

问题 I am invoking a bash shell script using oozie editor in Hue. I used the shell action in the workflow and tried below different options in shell command: Uploaded the shell script using 'choose a file' Gave local directory path where shell script is present Gave HDFS path where shell script is present But all these options gave following error: Cannot run program "sec_test_oozie.sh" (in directory "/data/hadoop/yarn/local/usercache/user/appcache/application_1399542362142_0086/container

HIVE GROUP_CONCAT with ORDER BY

阅读更多关于 HIVE GROUP_CONCAT with ORDER BY

来源： https://stackoverflow.com/questions/49028484/hive-group-concat-with-order-by

Hive timestamp format

阅读更多关于 Hive timestamp format

问题 I have some data with the following format: 28/04/2017 00:00:00|20550|22/05/2017 00:00:00| I am setting | as a separator. For the data in the first and third row in this example, I put timestamp as a data type in HUE, but I get null s as answer. I have looked around and it seems to me like Hive supports Unix format timestamp (from places like this ) But, I get a "Invalid date" message (I'm doing it with HUE so far, I'm still new with this technologies). If I try to make this data String, I

hive table created from parquet file not showing any data, even though data is there in parquet file

阅读更多关于 hive table created from parquet file not showing any data, even though data is there in parquet file

问题 I have a parquet file location which has data. using HUE , i created a hive table as below create external table parq_test ( A int, B int, C int ) STORED AS PARQUET LOCATION '/data/parq_test'; when I say select * from parq_test; It is returning 0 rows. I tried this MSCK REPAIR TABLE parq_test; still no luck below i tried but it is not supporting in my HUE console ALTER TABLE parq_test RECOVER PARTITIONS; Infact i test in my notebook , there is data available in my parquet file. So what is

Installing HUE 4

阅读更多关于 Installing HUE 4

Hue是一个开源的Apache Hadoop UI系统，最早是由Cloudera Desktop演化而来，由Cloudera贡献给开源社区，它是基于Python Web框架Django实现的。通过使用Hue我们可以在浏览器端的Web控制台上与Hadoop集群进行交互来分析处理数据，例如操作HDFS上的数据，运行MapReduce Job等等。HUE的特性如下图所示： HUE的架构图如下： 1、安装依赖软件包本文搭建HUE的平台是Oracle Linux 7.4。 [root@hdp01 ~]# yum -y install gcc-c++ asciidoc cyrus-sasl-devel cyrus-sasl-gssapi krb5-devel libxml2-devel libxslt-devel mysql-devel openldap-devel python-devel sqlite-devel openssl-devel gmp-devel libffi libffi-devel MySQL-python mysql-community-devel cyrus-sasl-plain 如果这些软件包不安装，在编译的过程中会报错，尤其是mysql相关的软件包，还有cryus-sasl。 2、安装HUE HUE的下载地址可以从http://gethue.com/官网找

HUE 配置参数优化

阅读更多关于 HUE 配置参数优化

1、图形页面表展示限制为5000，业务需要进行调整。参数如下 /opt/cloudera/parcels/CDH-5.14.2-1.cdh5.14.2.p0.3/lib/hue/apps/beeswax/src/beeswax/server/hive_server2_lib.py 744 max_rows=5000 754 max_rows=5000 771 max_rows=5000 784 max_rows=5000 2、hue 下载限制调整参数如下 /opt/cloudera/parcels/CDH/lib/hue/apps/beeswax/src/beeswax/conf.py +103 DOWNLOAD_CELL_LIMIT = Config( 102 key='download_cell_limit', 103 default=30000000, 104 type=int, 105 help=_t('A limit to the number of cells (rows * columns) that can be downloaded from a query ' 106 '(e.g. - 10K rows * 1K columns = 10M cells.) ' 107 'A value of -1 means there will be no limit.'

wpf 写个简单的控件吧

阅读更多关于 wpf 写个简单的控件吧

今天看到了老赵的一片博客：编写一个“绑定友好”的WPF控件文章里面遇到的问题，蛮有意思，后面的评论，非常精彩，没看过的，推荐看一下。由于我也做过类似的需求，所以，贴出我当时的做法和现在的想法，仅仅是笔记，没有其他意思。当时的需求类似这样子，实际做的效果当然比这个漂亮的多。看到这个UI的第一反应就是，封装一个控件，把slider包进去，很简单的吧。当时的做法，在CS代码里面封装几个DP，绑定就完事儿了呀。 <UserControl x:Class="WpfControlTest.UCSlider" xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation" xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml" Width="250" Height="45" xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006" x:Name="main" xmlns:d="http://schemas.microsoft.com/expression/blend/2008" > <Grid> <TextBlock Text="{Binding ElementName=main

Read an HDFS File from a HIVE UDF - Execution Error, return code 101 FunctionTask. Could not initialize class

阅读更多关于 Read an HDFS File from a HIVE UDF - Execution Error, return code 101 FunctionTask. Could not initialize class

问题 We have been trying to create a simple Hive UDF to mask some fields in a Hive Table. We are using an external file (placed on HDFS) to grab a piece of text to make a salting to the masking process. It seems we are doing everything ok but when we tried to create the external function it throws the error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.FunctionTask. Could not initialize

CM+CDH安装遇到的问题

阅读更多关于 CM+CDH安装遇到的问题

1、实在是在安装CDH的时候无法安装成功的话，只有重新启动了，下面给大家分享一个神器，按照这个脚本应该差不多就能卸载干净，然后重新安装，写一个脚本，内容如下，救命的神器呀： #!/bin/bash sudo /usr/share/cmf/uninstall-cloudera-manager.sh sudo service cloudera-scm-server stop sudo service cloudera-scm-server-db stop sudo service cloudera-scm-agent stop sudo yum remove cloudera-manager-agent sudo yum remove cloudera-manager-server sudo yum remove cloudera-manager-server-db-2 sudo yum remove 'cloudera-manager-*' bigtop-utils bigtop-jsvc bigtop-tomcat hadoop hadoop-hdfs hadoop-httpfs hadoop-mapreduce hadoop-yarn hadoop-client hadoop-0.20-mapreduce hue-plugins hbase hive oozie oozie