Friday, 13 October 2017

Full cache mode in Lookup transformation in SSIS

Read lookup transformation on below link
http://bageshkumarbagi-msbi.blogspot.in/2017/10/lookup-transformation-in-ssis.html

Here we will discuss details in Full Cache mode in lookup transformation and how its work.
This is the most commonly used approach in Lookup Transformation. If we selected this option then, entire lookup (or reference) table will be preloaded into the cache (Memory) and Lookup Transformation will perform a lookup from the Memory instead of Dataset. This works well when we have less number of rows in the lookup table. This is fast.
Here I am selecting Full cache mode


When we execute the package in pre- executing all the data loaded from the full cache.
Now executing the package.
Package executed successfully.

Now see the login progress.

In full cache, all data are loaded in pre-execution phase. Once data is loaded into the cache the package starts executing. Here we will get all details about the reference dataset. How many rows are added to the cache as well size of the data. Here we will get the execution time.
For better understanding, I am looking SQL executing in the SQL Profiler.
Read SQL Profiler here: SQL server profiler
Open the SQL Profiler
When we are running this package see the SQL Profiler

See one-time SQL query is executing and load the data into the full cache.

We can use this cache mode if we don’t want to hit sever again and again. If we are using the production server and the reference database is not a large then it will be better to use the full cache. It has some drawback like it consumes more space if the reference data set it large and our system doesn't have much space, in this case, the package has been failed.

7 comments:


  1. Through this post, I know that your good knowledge in playing with all the pieces was very helpful. I notify that this is the first place where I find issues I've been searching for. You have a clever yet attractive way of writing on Msbi online training
    Msbi online training Hyderabad
    Msbi online training India
    Msbi online course
    Msbi course
    Msbi training
    Msbi certification training

    ReplyDelete
  2. nice information thanks for sharing this article very useful for me ................!
    msbi course training

    ReplyDelete
  3. Such an informative post Thanks for sharing. We are providing the best services click on below links to visit our website.
    pega online training
    best pega online training
    onlineitguru is best in pega online training

    ReplyDelete
  4. Thanks for this insightful overview of Pega! I found your discussion on its low-code capabilities especially valuable, as it really empowers business users to contribute to app development. It would be great to know more about any challenges you’ve faced during implementation and how you overcame them. Looking forward to more of your posts!

    best mulesoft online training
    best mulesoft training

    ReplyDelete

If you have any doubt, please let me know.

Popular Posts