Appendix B: Auto-generated Data Model
The AI-Driven Social Media Dashboard creates columns and data types in Athena after tweets are ingested, translated, and analyzed.
The following table contains tweets data types.
Name | Type |
---|---|
coordinates | struct<type:string,coordinates:array<double>> |
retweeted | boolean |
source | string |
entities | struct<hashtags:array<struct<text:string,indices:array<bigint>>>,urls:array<struct<url:string,expanded_url:string,display_url:string,indices:array<bigint>>>> |
reply_count | bigint |
favorite_count | bigint |
geo | struct<type:string,coordinates:array<double>> |
id_str | string |
timestamp_ms | bigint |
truncated | boolean |
text | string |
retweet_count | bigint |
id | bigint |
possibly_sensitive | boolean |
filter_level | string |
created_at | string |
place | struct<id:string,url:string,place_type:string,name:string,full_name:string,country_code:string,country:string,bounding_box:struct<type:string,coordinates:array<array<array<float>>>>> |
favorited | boolean |
lang | string |
in_reply_to_screen_name | string |
user | struct<id:bigint,id_str:string,name:string,screen_name:string,location:string,url:string,description:string,translator_type:string,protected:boolean,verified:boolean,followers_count:bigint,friends_count:bigint,listed_count:bigint,favourites_count:bigint,statuses_count:bigint,created_at:string,utc_offset:bigint,time_zone:string,geo_enabled:boolean,lang:string,contributors_enabled:boolean,is_translator:boolean,profile_background_color:string,profile_background_image_url:string,profile_background_image_url_https:string,profile_background_tile:boolean,profile_link_color:string,profile_sidebar_border_color:string,profile_sidebar_fill_color:string,profile_text_color:string,profile_use_background_image:boolean,profile_image_url:string,profile_image_url_https:string,profile_banner_url:string,default_profile:boolean,default_profile_image:boolean> |
quote_count | bigint |
The following table contains tweet_sentiment
data types.
Name | Type |
---|---|
tweet_id | bigint |
text | string |
originaltext | string |
sentiment | string |
sentimentposscore | double |
sentimentnegscore | double |
sentimentneuscore | double |
sentimentmixedscore | double |
The following table contains tweet_entities
data types
Name | Type |
---|---|
tweet_id | bigint |
entity | string |
type | string |
score | double |