streaming data postgresql-python-API

[indhu]

Hi all, 

I am a naive user trying to play around streaming dataset and would really like your help. 

I am trying to get the query from PostgreSQL and use python to push into API. The doubt I have is when I use the sql code as, 

sql = "select * from table where date >= now() and city='chennai';"

doesn't work as it gets data from that time only and repeats. 

When I use the following code, It runs for a long time but doesn't work

sql = "select * from table where city='chennai';"

Am I using it correctly? Can we use where clause? 

Thanks,

Indhu

[v-jiascu-msft · Accepted solution]

Hi Indhu,

Both of the SQL statements look great. The problem is if there isn't any new data in the PostgreSQL, the results of these SQLs are always the same. There could be two solutions. 

1. Add new data to the source. 

2. Change the SQL statements to make them retrieve dynamic data. For instances, 

# usually, this block is in a loop.

date = datetime.date.today()
sql = "select * from table where city='chennai' and date = '" + str(date) + "'"
date += datetime.timedelta(days = 1)

Best Regards,
Dale