CacheManager

Caching Logical Plan (cacheQuery method)

When you cache or persist a Dataset, they pass the call to cacheQuery method.

cacheQuery(
  query: Dataset[_],
  tableName: Option[String] = None,
  storageLevel: StorageLevel = MEMORY_AND_DISK): Unit

cacheQuery obtains analyzed logical plan and saves it as a InMemoryRelation in the internal cachedData cached queries collection.

If however the query has already been cached, you should instead see the following WARN message in the logs:

WARN CacheManager: Asked to cache already cached data.

results matching ""

    No results matching ""