www.it-ebooks.info www.it-ebooks.info Working with Microsoft ® FAST™ Search Server 2010 for SharePoint ® Mikael Svenson Marcus Johansson Robert Piddocke www.it-ebooks.info Published with the authorization of Microsoft Corporation by: O’Reilly Media, Inc. 1005 Gravenstein Highway North Sebastopol, California 95472 Copyright © 2012 by Mikael Svenson, Marcus Johansson, Robert Piddocke All rights reserved. No part of the contents of this book may be reproduced or transmitted in any form or by any means without the written permission of the publisher. ISBN: 978-0-7356-6222-3 1 2 3 4 5 6 7 8 9 LSI 7 6 5 4 3 2 Printed and bound in the United States of America. Microsoft Press books are available through booksellers and distributors worldwide. If you need support related to this book, email Microsoft Press Book Support at [email protected]. Please tell us what you think of this book at http://www.microsoft.com/learning/booksurvey. Microsoft and the trademarks listed at http://www.microsoft.com/about/legal/en/us/IntellectualProperty/ Trademarks/EN-US.aspx are trademarks of the Microsoft group of companies. All other marks are property of their respective owners. The example companies, organizations, products, domain names, email addresses, logos, people, places, and events depicted herein are fictitious. No association with any real company, organization, product, domain name, email address, logo, person, place, or event is intended or should be inferred. This book expresses the author’s views and opinions. The information contained in this book is provided without any express, statutory, or implied warranties. Neither the authors, O’Reilly Media, Inc., Microsoft Corporation, nor its resellers, or distributors will be held liable for any damages caused or alleged to be caused either directly or indirectly by this book. Acquisitions and Developmental Editor: Russell Jones Production Editor: Holly Bauer Editorial Production: Online Training Solutions, Inc. Technical Reviewer: Thomas Svensen Copyeditor: Jaime Odell, Online Training Solutions, Inc. Indexer: Judith McConville Cover Design: Twist Creative • Seattle Cover Composition: Karen Montgomery Illustrator: Jeanne Craver, Online Training Solutions, Inc. www.it-ebooks.info Contents at a Glance Foreword xiii Introduction xv Part I WHat YOU NeeD TO KNOW CHAPTER 1 Introduction to FAST Search Server 2010 for SharePoint 3 CHAPTER 2 Search Concepts and Terminology 29 CHAPTER 3 FS4SP Architecture 53 CHAPTER 4 Deployment 73 CHAPTER 5 Operations 115 ParT II CreatinG SeaRCH SOLUtiOns CHAPTER 6 Search Configuration 161 CHAPTER 7 Content Processing 235 CHAPTER 8 Querying the Index 289 CHAPTER 9 Useful Tips and Tricks 329 CHAPTER 10 Search Scenarios 389 Index 445 www.it-ebooks.info Contents Foreword .......................................................xiii Introduction .....................................................xv P ART I WHAT YOU NEED TO KNOW Chapter 1 Introduction to FAST Search Server 2010 for SharePoint 3 What Is FAST? ....................................................3 Past ........................................................4 Present .....................................................4 Future ......................................................5 Versions ....................................................5 SharePoint Search vs. Search Server Versions, and FS4SP. 9 Features at a Glance .........................................9 Explanation of Features ......................................11 What Should I Choose? ...........................................19 Evaluating Search Needs. .19 Decision Flowchart ..........................................23 Features Scorecard ..........................................23 Conclusion ......................................................28 Chapter 2 Search Concepts and Terminology 29 Overview ........................................................29 Relevancy ..................................................30 SharePoint Components .....................................35 What do you think of this book? We want to hear from you! Microsoft is interested in hearing your feedback so we can continually improve our books and learning resources for you. To participate in a brief online survey, please visit: microsoft.com/learning/booksurvey v www.it-ebooks.info Content Processing ...............................................40 Content Sources ............................................40 Crawling and Indexing ......................................41 Metadata ..................................................43 Index Schema ..............................................43 Query Processing ................................................44 QR Server .................................................45 Refiners (Faceted Search) ....................................45 Query Language. .45 Search Scopes ..............................................47 Security Trimming ..........................................51 Claims-Based Authentication .................................52 Conclusion ......................................................52 Chapter 3 FS4SP Architecture 53 Overview ........................................................53 Server Roles and Components .....................................56 FS4SP Architecture ..........................................57 Search Rows, Columns, and Clusters. .67 FS4SP Index Servers .........................................70 FS4SP Query Result Servers/QR Server ........................70 Conclusion ......................................................71 Chapter 4 Deployment 73 Overview ........................................................73 Hardware Requirements ..........................................74 Storage Considerations ......................................74 FS4SP and Virtualization .....................................78 Software Requirements ...........................................79 Installation Guidelines ............................................80 Before You Start ............................................81 Software Prerequisites. 84 FS4SP Preinstallation Configuration ...........................87 vi Contents www.it-ebooks.info FS4SP Update Installation ....................................87 FS4SP Slipstream Installation .................................89 Single-Server FS4SP Farm Configuration .......................90 Deployment Configuration. .94 Multi-Server FS4SP Farm Configuration ........................95 Manual and Automatic Synchronization of Configuration Changes ...................................................96 Certificates and Security .....................................97 Creating FAST Content SSAs and FAST Query SSAs ..............99 Enabling Queries from SharePoint to FS4SP ...................100 Creating a Search Center ...................................100 Scripted Installation. .101 Advanced Filter Pack .......................................101 IFilter .....................................................103 Replacing the Existing SharePoint Search with FS4SP ................104 Development Environments ......................................104 Single-Server Farm Setup ...................................105 Multi-Server Farm Setup ....................................105 Physical Machines .........................................106 Virtual Machines ...........................................106 Booting from a VHD .......................................106 Production Environments ........................................106 Content Volume ...........................................107 Failover and High Availability ...............................108 Query Throughput .........................................108 Freshness .................................................110 Disk Sizing ................................................110 Server Load Bottleneck Planning ............................112 Conclusion .....................................................113 Chapter 5 Operations 115 Introduction to FS4SP Operations .................................115 Administration in SharePoint ................................116 Administration in Windows PowerShell .......................116 Other Means of Administration. .117 Contents vii www.it-ebooks.info Basic Operations ................................................117 The Node Controller .......................................118 Indexer Administration .....................................124 Search Administration ......................................127 Search Click-Through Analysis. 128 Link Analysis ..............................................129 Server Topology Management ....................................133 Modifying the Topology on the FS4SP Farm ..................133 Modifying the Topology on the SharePoint Farm ..............135 Changing the Location of Data and Log Files ..................136 Logging ........................................................138 General-Purpose Logs ......................................138 Functional Logs ...........................................141 Performance Monitoring .........................................146 Identifying Whether an FS4SP Farm Is an Indexing Bottleneck ...............................................148 Identifying Whether the Document Processors Are the Indexing Bottleneck ........................................148 Identifying Whether Your Disk Subsystem Is a Bottleneck .......148 Backup and Recovery ............................................149 Prerequisites ..............................................151