How to fix AttributeError: 'module' object has no attribute 'Client' when running python in Google Cloud Interactive Shell

你说的曾经没有我的故事 提交于 2019-12-10 19:40:03

问题


I'm trying to run a python script that simulates traffic sensors sending in data in real time to PubSub on my Google Cloud Shell. I'm getting this error

Traceback (most recent call last):
  File "./send_sensor_data.py", line 87, in <module>
    psclient = pubsub.Client()
AttributeError: 'module' object has no attribute 'Client'

Tried running google.cloud.pubsub.__file__, no duplicates exist. I've been searching everywhere and the popular consensus was to install the pubsub package into a virtual environment which I've tried to no avail. What I've tried so far:

  • Set VM to clean state
  • Uninstalled and reinstalled all gcloud components
  • Updated all gcloud components to the latest version
  • uninsalled and reinstalled python pubsub library
  • Installed pubsub inside a virtualenv
  • Tried from a different project
  • Tried from a different GCP account

This is my script:

import time
import gzip
import logging
import argparse
import datetime
from google.cloud import pubsub

TIME_FORMAT = '%Y-%m-%d %H:%M:%S'
TOPIC = 'sandiego'
INPUT = 'sensor_obs2008.csv.gz'

def publish(topic, events):
   numobs = len(events)
   if numobs > 0:
      with topic.batch() as batch:
         logging.info('Publishing {} events from {}'.
                    format(numobs, get_timestamp(events[0])))
         for event_data in events:
              batch.publish(event_data)

def get_timestamp(line):
   # look at first field of row
   timestamp = line.split(',')[0]
   return datetime.datetime.strptime(timestamp, TIME_FORMAT)

def simulate(topic, ifp, firstObsTime, programStart, speedFactor):
   # sleep computation
   def compute_sleep_secs(obs_time):
        time_elapsed = (datetime.datetime.utcnow() - programStart).seconds
        sim_time_elapsed = (obs_time - firstObsTime).seconds / speedFactor
        to_sleep_secs = sim_time_elapsed - time_elapsed
        return to_sleep_secs

   topublish = list() 

   for line in ifp:
       event_data = line   # entire line of input CSV is the message
       obs_time = get_timestamp(line) # from first column

       # how much time should we sleep?
       if compute_sleep_secs(obs_time) > 1:
          # notify the accumulated topublish
          publish(topic, topublish) # notify accumulated messages
          topublish = list() # empty out list

          # recompute sleep, since notification takes a while
          to_sleep_secs = compute_sleep_secs(obs_time)
          if to_sleep_secs > 0:
             logging.info('Sleeping {} seconds'.format(to_sleep_secs))
             time.sleep(to_sleep_secs)
       topublish.append(event_data)

   # left-over records; notify again
   publish(topic, topublish)

def peek_timestamp(ifp):
   # peek ahead to next line, get timestamp and go back
   pos = ifp.tell()
   line = ifp.readline()
   ifp.seek(pos)
   return get_timestamp(line)


if __name__ == '__main__':
   parser = argparse.ArgumentParser(description='Send sensor data to Cloud Pub/Sub in small groups, simulating real-time behavior')
   parser.add_argument('--speedFactor', help='Example: 60 implies 1 hour of data sent to Cloud Pub/Sub in 1 minute', required=True, type=float)
   args = parser.parse_args()

   # create Pub/Sub notification topic
   logging.basicConfig(format='%(levelname)s: %(message)s', level=logging.INFO)
   psclient = pubsub.Client()
   topic = psclient.topic(TOPIC)
   if not topic.exists():
      logging.info('Creating pub/sub topic {}'.format(TOPIC))
      topic.create()
   else:
      logging.info('Reusing pub/sub topic {}'.format(TOPIC))

   # notify about each line in the input file
   programStartTime = datetime.datetime.utcnow() 
   with gzip.open(INPUT, 'rb') as ifp:
      header = ifp.readline()  # skip header
      firstObsTime = peek_timestamp(ifp)
      logging.info('Sending sensor data from {}'.format(firstObsTime))
      simulate(topic, ifp, firstObsTime, programStartTime, args.speedFactor)

回答1:


The pubsub.Client class exists until the 0.27.0 version of the pubsub python package. So I just created a virtual environment and installed the 0.27.0 version of pubsub into it. Here are the commands:

virtualenv venv
source venv/bin/activate
pip install google-cloud-pubsub==0.27.0



回答2:


Solution for Google Cloud Platforms is:

  1. Modify the send_senor_data.py file as follows:

    a. Comment the original import statement for pub_sub and use _v1 version

      #from google.cloud import pubsub
       from google.cloud import pubsub_v1
    

    b. Find this code and replace it as follows:

      #publisher = pubsub.PublisherClient()
      publisher = pubsub_v1.PublisherClient()
    
    1. Then execute your send_sensor_data.py as follows:

      ./send_sensor_data.py --speedFactor=60 --project=YOUR-PROJECT-NAME




回答3:


There's no pubsub.Client class. You need to choose a PublisherClient or SubscriberClient

see https://github.com/GoogleCloudPlatform/google-cloud-python/blob/master/pubsub/google/cloud/pubsub.py



来源:https://stackoverflow.com/questions/47362736/how-to-fix-attributeerror-module-object-has-no-attribute-client-when-runnin

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!