| CASTLE: A CONTEXT-AWARE SPATIAL-TEMPORAL LOCATION EMBEDDING PRE-TRAINING MODEL FOR NEXT LOCATION PREDICTION |
| Paper ID : 1090-GEOSPATIAL (R5) |
| Authors: |
|
junyi cheng *, Jie Huang, xianfeng zhang Institute of Remote Sensing and Geographic Information Systems, Peking University, Beijing, China |
| Abstract: |
| Next location prediction is of great significance for service recommendation, public safety, intelligent transportation, and other location-based applications. Existing location prediction methods usually use sparse check-in trajectories and require massive historical data to capture the complex spatial-temporal correlations. High spatial-temporal resolution trajectories has rich information. However, obtaining personal trajectories with long time series and high spatiotemporal resolution usually proves challenging. Herein, this paper proposes a two-stage Context-Aware Spatial-Temporal Location Embedding (CASTLE) model, a multi-modal pre-training model for sequence-to-sequence prediction tasks. The method is built in two steps. First, large-scale location datasets, which are sparse but easier to be acquired (i.e., check-in and anomalous navigation data), are used for pre-training location embedding to capture the multi-functional properties under different contexts. After that, the learned contextual embedding is used for downstream location prediction in small-scale but higher spatiotemporal resolution trajectory datasets. Specifically, the CASTLE model combines Bidirectional and Auto-Regressive Transformers to address the issue that the existing location embedding methods only assign a fix latent vector for each location. Furthermore, we introduce a location and time aware encoder to reflect the spatial distances between locations and the visit times. Experiments are conducted on two real trajectory datasets. The results show that the CASTLE model can pre-train beneficial location embedding and outperforms the model without pre-training by 4.6-7.1%. The proposed method is expected to improve the next location prediction accuracy without massive historical data, which will greatly improve the availability of trajectory data. |
| Keywords: |
| Geospatial data, Ubiquitous computing, Location prediction, Location embedding, Trajectory mining, Smart city. |
| Status : Paper Accepted (Oral Presentation) |
